-- Logs begin at Thu 2021-11-11 15:40:31 UTC, end at Thu 2021-11-11 16:50:38 UTC. -- Nov 11 16:13:38.081292 dv-cinder-776422-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 11 16:13:38.090811 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 11 16:13:38 2021] *** Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: nodename: dv-cinder-776422-4-iscsi Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: machine: x86_64 Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: clock source: unix Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: pcre jit disabled Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: detected number of CPU cores: 4 Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: current working directory: / Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: detected binary path: /usr/bin/uwsgi-core Nov 11 16:13:38.092697 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: your processes number limit is 47680 Nov 11 16:13:38.093534 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: your memory page size is 4096 bytes Nov 11 16:13:38.093534 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: detected max file descriptor number: 2048 Nov 11 16:13:38.093534 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: lock engine: pthread robust mutexes Nov 11 16:13:38.093534 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: thunder lock: enabled Nov 11 16:13:38.093534 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 11 16:13:38.093534 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 11 16:13:38.138659 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: Python main interpreter initialized at 0x55d0277029c0 Nov 11 16:13:38.138659 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: python threads support enabled Nov 11 16:13:38.138659 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: your server socket listen backlog is limited to 100 connections Nov 11 16:13:38.138659 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: your mercy for graceful operations on workers is 90 seconds Nov 11 16:13:38.139029 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: mapped 403077 bytes (393 KB) for 2 cores Nov 11 16:13:38.139107 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: *** Operational MODE: preforking *** Nov 11 16:13:38.139347 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: *** uWSGI is running in multiple interpreter mode *** Nov 11 16:13:38.139347 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: spawned uWSGI master process (pid: 79337) Nov 11 16:13:38.139551 dv-cinder-776422-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 11 16:13:38.142428 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: spawned uWSGI worker 1 (pid: 79350, cores: 1) Nov 11 16:13:38.142428 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: spawned uWSGI worker 2 (pid: 79351, cores: 1) Nov 11 16:13:38.142428 dv-cinder-776422-4-iscsi devstack@keystone.service[79337]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 11 16:13:43.327197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:13:43.327197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: from cryptography.utils import int_from_bytes Nov 11 16:13:43.327979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:13:43.327979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: from cryptography.utils import int_from_bytes Nov 11 16:13:43.330314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:13:43.330314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: from cryptography.utils import int_from_bytes Nov 11 16:13:43.330781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:13:43.330781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: from cryptography.utils import int_from_bytes Nov 11 16:13:43.376641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 16:13:43.376835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 16:13:43.377030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] command line args: [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 16:13:43.377304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 16:13:43.377484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ================================================================================ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 16:13:43.377739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] admin_token = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.377985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config_dir = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.378069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 16:13:43.378308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.378403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 16:13:43.378561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config_source = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.378642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] command line args: [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 16:13:43.378721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] debug = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.378798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 16:13:43.378874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ================================================================================ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 16:13:43.379138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] admin_token = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config_dir = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config_source = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.379901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] debug = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_config_append = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_dir = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.380975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_config_append = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_dir = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.381981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.382105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.382770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.382957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.383198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.383288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.383430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.383518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.383666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.383822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.383905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384302 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384632 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.384979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] publish_errors = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.385897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386017 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] standard_threads = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.386972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] publish_errors = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_journal = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_json = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.387927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_stderr = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_syslog = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] standard_threads = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.388731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.388975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.388975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.389234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.389355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_journal = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.389482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.389601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_json = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.389601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_stderr = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.389817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.389931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_syslog = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.390051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.390200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:13:43.390319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.390434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.390548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.390673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.390788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.390915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391742 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.391953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.392921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.393939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.394914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395389 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.395978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.396928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.397043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.397158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.397272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.397401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.397518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.397637 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.397767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.398519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.398683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.398814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.398940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.399897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.400956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.401928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.402937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.403991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.404948 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405194 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.405911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.406887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407117 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.407841 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.408203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.408325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.408441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.408564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.408681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.408794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.408915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.409978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.410939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411755 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.external = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.411982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.password = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.412924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.token = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.external = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.413774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.414910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.password = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.token = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.415983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.416924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.417975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.418934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.419880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.420922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.421955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.422929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423276 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.423979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.424921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.425981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.426947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.427896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.428971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.429115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.429233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.429351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.429506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.429649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.429766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.429882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.430922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.431968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.432917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433033 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.433970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.434929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.435972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436213 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436806 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.436920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437035 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.437981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.438216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.438333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.438461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.438584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.438700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.438815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.438930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439285 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.439976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.440945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441309 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441309 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.441990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.442984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.443200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.443317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.443441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.443563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.443680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.443795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.443909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.444024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.444148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.444265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.444381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.444497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.445128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.445300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.445492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.445665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.445788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.445905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.446949 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.447888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.448893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.449967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.450977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.451801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.452968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.453972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454477 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.454941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455635 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.455982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.456789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.457937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458202 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.458912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.459972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.460088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.460204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.460965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461841 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.461967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.462317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.462432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.462548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.462677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 16:13:43.462796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.462796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.462796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.462796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.463214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.463214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.463439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.463631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.463883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.464123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.464371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.464605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.464849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.465086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:13:43.465257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 16:13:43.492947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.493178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.493412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.496268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.496500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.496730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.502040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.505212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.531232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.531473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.532655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.533152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.587586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.587748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.726153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.726375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.726996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.727237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.791425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.791650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.791875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.792984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.793208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.817429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.817665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.817760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.817890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.818924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.819140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.829982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.830083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.842756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.842938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.843992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.844067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.844141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.844215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:13:43.861663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.861874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:13:43.862114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.862223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.862357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:13:43.862455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:13:43.862694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.862775 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.862894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:13:43.862976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.863163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.863255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.863420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.863501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.863674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.863926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.874691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.874826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.874973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.875103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.875244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.875368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.875529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.875642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.884121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.884238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.887363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.887501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.887641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.887724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.887920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.888993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.889076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.889260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.889375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.889630 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.889719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.889906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.889987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.890194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.890297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.917154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.917352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.918771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.918973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.919069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.919256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.924348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.924551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.924634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.924833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.924924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.925115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.932230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.932432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.933396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.933536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.936947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.937109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.937258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.937390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.937529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.937663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.937794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.937931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.938139 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.938310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.938445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.938592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.938713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.938867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.938978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.939142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.957915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.958014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.958222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.958315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.962946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.963074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.966508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.966675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.966804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.966982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.971735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.971946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.975275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.975505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:43.979467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.979762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.979882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.980050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.980184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.980444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.980535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.980731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.980849 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.981021 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.981110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.981400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:43.999988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.000177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.000261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.000465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.000546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.000735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.000817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.000997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.009331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.009503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.011023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.011228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.011316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.011507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.014314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.014519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.014603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.014804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.014888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.015087 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.015177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.015386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.015470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.015672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.028500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.028774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.028921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.029048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.029206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.029307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.029487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.029571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.029768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.029852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.030055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.030146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.030356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.030640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.048345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.049135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.052811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.053726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.056106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.057090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.057693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.058709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.059324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.059601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.059883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.060321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.060603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.060887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.067122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.068180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.068690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.070425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.072437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.072724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.073004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.073278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.073600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.073892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.074198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.074477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.082160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.082471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.082748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.083413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.083701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.083978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.090634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.090912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.091188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.091460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.091737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.091971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:13:44.092053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.092253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.092346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.092522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.092604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.092827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.092917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.093932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.094105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.094207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.094417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.094702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.094974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.095239 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.095499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:13:44.133053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0277029c0 pid: 79351 (default app) Nov 11 16:13:44.134446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0277029c0 pid: 79350 (default app) Nov 11 16:13:44.136291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6efc2-2cf7-4391-95c1-329ed982af1f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:44.136577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6efc2-2cf7-4391-95c1-329ed982af1f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:44.136849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6efc2-2cf7-4391-95c1-329ed982af1f None None] PATH_INFO: `/v3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:44.141187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1/1] 10.222.0.11 () {50 vars in 791 bytes} [Thu Nov 11 16:13:44 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:13:52.650663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7c94-ba66-4baf-9c15-cf70328b594e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:52.651173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7c94-ba66-4baf-9c15-cf70328b594e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:52.651258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef7c94-ba66-4baf-9c15-cf70328b594e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:52.656658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1/2] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:13:52 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:13:52.663965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:52.664352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:52.664530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:52.695239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG oslo_db.sqlalchemy.engines [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 16:13:52.882057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG passlib.handlers.bcrypt [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 11 16:13:52.882430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG passlib.handlers.bcrypt [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 11 16:13:52.937391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:13:52.939041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:13:53.070826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 2/3] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:13:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:13:53.184089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef7c94-ba66-4baf-9c15-cf70328b594e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:53.217149 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG oslo_db.sqlalchemy.engines [None req-4aef7c94-ba66-4baf-9c15-cf70328b594e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 16:13:53.348146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef7c94-ba66-4baf-9c15-cf70328b594e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:53.352451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040193a-d6b5-4888-b645-af0c9f83894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:53.353103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040193a-d6b5-4888-b645-af0c9f83894d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:53.353393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040193a-d6b5-4888-b645-af0c9f83894d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:53.353676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040193a-d6b5-4888-b645-af0c9f83894d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:53.361646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040193a-d6b5-4888-b645-af0c9f83894d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:53.412423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0040193a-d6b5-4888-b645-af0c9f83894d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 11 16:13:53.412762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040193a-d6b5-4888-b645-af0c9f83894d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:53.422054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 2/4] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:13:53 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:13:53.429349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:53.444210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65dc5-56b2-4139-b2df-d9e9d7b8ac45 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:53.448594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c2eb2-64e3-47aa-b3ed-532b247d4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:53.449683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c2eb2-64e3-47aa-b3ed-532b247d4531 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:53.449968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c2eb2-64e3-47aa-b3ed-532b247d4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:53.450276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c2eb2-64e3-47aa-b3ed-532b247d4531 admin admin] PATH_INFO: `/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:53.451766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c2eb2-64e3-47aa-b3ed-532b247d4531 admin admin] RBAC: Authorizing `identity:get_project(project_id=9e90b3c560e34b33b6dbbbe37d81f1b5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:53.503468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c7c2eb2-64e3-47aa-b3ed-532b247d4531 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 11 16:13:53.503807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c2eb2-64e3-47aa-b3ed-532b247d4531 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:53.508381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 3/5] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:13:53 2021] GET /identity/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:13:55.737047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e0f8-817d-4701-a3b9-370ae380c91c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:55.737617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e0f8-817d-4701-a3b9-370ae380c91c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:55.737617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e0f8-817d-4701-a3b9-370ae380c91c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:55.742199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 3/6] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:13:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:13:55.748401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d6de8-a2a9-4c8f-8e3a-35fa63a11bb6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:55.748791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d6de8-a2a9-4c8f-8e3a-35fa63a11bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:55.748959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d6de8-a2a9-4c8f-8e3a-35fa63a11bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:55.767888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-938d6de8-a2a9-4c8f-8e3a-35fa63a11bb6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:13:55.769498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-938d6de8-a2a9-4c8f-8e3a-35fa63a11bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:13:55.777579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 4/7] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:13:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:13:55.801789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e0f8-817d-4701-a3b9-370ae380c91c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:55.813360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556e0f8-817d-4701-a3b9-370ae380c91c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:55.818230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0c52c-dc73-4391-a070-596c2bf1dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:55.818852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0c52c-dc73-4391-a070-596c2bf1dfcd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:55.819131 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0c52c-dc73-4391-a070-596c2bf1dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:55.819409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0c52c-dc73-4391-a070-596c2bf1dfcd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:55.826859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0c52c-dc73-4391-a070-596c2bf1dfcd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:55.828617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0c52c-dc73-4391-a070-596c2bf1dfcd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:55.837692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 4/8] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:13:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:13:55.844788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d6de8-a2a9-4c8f-8e3a-35fa63a11bb6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:55.854367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d6de8-a2a9-4c8f-8e3a-35fa63a11bb6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:55.858664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca7b43-9d7b-45ec-9bf6-baa73beff571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:55.859507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca7b43-9d7b-45ec-9bf6-baa73beff571 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:55.859786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca7b43-9d7b-45ec-9bf6-baa73beff571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:55.860056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca7b43-9d7b-45ec-9bf6-baa73beff571 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:55.862387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca7b43-9d7b-45ec-9bf6-baa73beff571 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:55.864207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca7b43-9d7b-45ec-9bf6-baa73beff571 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:55.865734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 5/9] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:13:55 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:13:58.177900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb76b5-e161-42d1-b3f5-f1d71c5579b5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.178457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb76b5-e161-42d1-b3f5-f1d71c5579b5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.178540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb76b5-e161-42d1-b3f5-f1d71c5579b5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.180236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 5/10] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:13:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:13:58.183521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c640-e7c6-4409-993a-7ca29fea79ab None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.183918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c640-e7c6-4409-993a-7ca29fea79ab None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.184081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c640-e7c6-4409-993a-7ca29fea79ab None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.185833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.186081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 6/11] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:13:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:13:58.186194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.186405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.192675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0be7d-4781-4005-93b1-bce895387ac5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.192967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0be7d-4781-4005-93b1-bce895387ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.193247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0be7d-4781-4005-93b1-bce895387ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.211396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-75d0be7d-4781-4005-93b1-bce895387ac5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:13:58.212601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-75d0be7d-4781-4005-93b1-bce895387ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:13:58.220739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 7/12] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:13:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:13:58.228478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG passlib.handlers.bcrypt [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79350) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 11 16:13:58.228892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG passlib.handlers.bcrypt [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79350) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 11 16:13:58.244269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0be7d-4781-4005-93b1-bce895387ac5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:58.253788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0be7d-4781-4005-93b1-bce895387ac5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:58.258200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:58.258815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.259098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.259369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.268028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:58.269813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:58.275379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:13:58.277222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:13:58.278744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 8/13] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:13:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:13:58.286610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:58.295189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d83c7-f206-48d3-b82a-3007af6961f7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:58.300094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:58.300847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.301130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.301407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.302443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 6/14] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:13:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:13:58.302641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:58.304333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:58.305859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 9/15] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:13:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:13:58.328358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:58.338690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05b1fb-7801-4a85-9800-ddbc562e8339 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:58.343270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:58.344965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.345465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.345864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.363179 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:13:58.370291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:13:58.371855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 7/16] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:13:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:13:58.378454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:58.388844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dbcdc-1567-4ac0-b497-b6a7898ad8b8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:58.393936 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:58.394761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.395055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.395334 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.396119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:13:58.396427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:58.398260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:13:58.398260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:13:58.398260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:13:58.399202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:58.415562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 10/17] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:13:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:13:58.422210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:58.433379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c406b-4170-475e-a998-de7dd49fa888 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:58.437770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:58.438710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.438992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.439266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.440873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:58.442814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:58.444497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 8/18] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:13:58 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:13:58.450739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:58.461681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9d592-37be-48b0-9d91-7e7f83b486be admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:58.466351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5786a5e-4cca-47be-8f1f-5c348a08bfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:58.467158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5786a5e-4cca-47be-8f1f-5c348a08bfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.467444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5786a5e-4cca-47be-8f1f-5c348a08bfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.467722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5786a5e-4cca-47be-8f1f-5c348a08bfd4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.468959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5786a5e-4cca-47be-8f1f-5c348a08bfd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:58.471571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5786a5e-4cca-47be-8f1f-5c348a08bfd4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:58.473200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 11/19] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:13:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:13:58.479733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:13:58.491140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30df5-7e32-425a-8af4-a7e43a250875 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:13:58.495619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:13:58.496271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:13:58.496551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:13:58.496826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:13:58.497680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.domain.id=default, user.id=6fe756dac77c46179eda340982f2b52b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:13:58.497985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:13:58.499756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:13:58.499756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:13:58.499756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:13:58.501228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233bfac-93e7-42ce-b108-fd22f91913b2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:13:58.510515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 9/20] 10.222.0.11 () {56 vars in 1343 bytes} [Thu Nov 11 16:13:58 2021] GET /identity/v3/role_assignments?user.id=6fe756dac77c46179eda340982f2b52b&scope.domain.id=default&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:01.130022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b3df-5fde-48fb-a6d9-e8967950c530 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.130551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b3df-5fde-48fb-a6d9-e8967950c530 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.130623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b3df-5fde-48fb-a6d9-e8967950c530 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.132381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 12/21] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:01.148438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f2278-0695-401b-af09-42f0c0820699 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.148922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f2278-0695-401b-af09-42f0c0820699 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.148992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f2278-0695-401b-af09-42f0c0820699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.173184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-349f2278-0695-401b-af09-42f0c0820699 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:01.174424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-349f2278-0695-401b-af09-42f0c0820699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:01.182597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 10/22] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:01.229096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302b3df-5fde-48fb-a6d9-e8967950c530 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.246848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302b3df-5fde-48fb-a6d9-e8967950c530 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.252258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.252890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.253174 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.253451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.254254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.255382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:01.255382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:01.255382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:01.269823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.281246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d3b9-7221-4de3-9ae0-2227d8376fac None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.281550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d3b9-7221-4de3-9ae0-2227d8376fac None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.281880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d3b9-7221-4de3-9ae0-2227d8376fac None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.283929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 11/23] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:01.290440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1b54-e2a2-47c4-97d7-28e46a5a2818 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.291010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1b54-e2a2-47c4-97d7-28e46a5a2818 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.291501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1b54-e2a2-47c4-97d7-28e46a5a2818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.310711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-998d1b54-e2a2-47c4-97d7-28e46a5a2818 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:01.312768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-998d1b54-e2a2-47c4-97d7-28e46a5a2818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:01.321032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 12/24] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:01.326451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7aaf9-2fa3-4c53-a55c-3aeee6fd62dd None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.327144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7aaf9-2fa3-4c53-a55c-3aeee6fd62dd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.328529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7aaf9-2fa3-4c53-a55c-3aeee6fd62dd None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.330913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 13/25] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:01 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:01.336781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9092a3-3513-47c0-bd41-46f95fb1f9b4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.337320 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9092a3-3513-47c0-bd41-46f95fb1f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.337801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9092a3-3513-47c0-bd41-46f95fb1f9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.362406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ee9092a3-3513-47c0-bd41-46f95fb1f9b4 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:01.364068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ee9092a3-3513-47c0-bd41-46f95fb1f9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:01.373457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 14/26] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:01.458265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9092a3-3513-47c0-bd41-46f95fb1f9b4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.458265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9092a3-3513-47c0-bd41-46f95fb1f9b4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.458265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.458265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.458719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.458719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.470633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:01.496290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:01.497864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 15/27] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:01.498574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.510088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b0229-54ab-4db0-873e-38c38f4e062a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.515163 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.516139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.516430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.516884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.539781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.540999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.574738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 13/28] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:14:01 2021] POST /identity/v3/roles => generated 219 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:01.578110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.582826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:01.584084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 16/29] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:01.594922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.605780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937209-1976-419f-a0e9-accdf219c997 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.614917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912836d-6171-47a2-98e8-2d6d11c7e4ce admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.624638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.625334 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.625659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.626520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.627368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:01.628168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.630103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.635646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.636323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.636608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.636885 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.637663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:01.637975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.639057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:01.639057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:01.639057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:01.640529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.652979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 14/30] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:01.660554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.676671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2907-39c5-47dc-bf72-00761726ec7b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.679347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 17/31] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:01.681664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.682586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.682877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.683161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.684592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.685259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.686617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.688868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 15/32] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:01 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:01.695236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.704848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e4f74-5cc3-47d6-8b74-c88435d5d150 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.706407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6d253-6cac-4a8a-b86f-e6cbdb9209c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.712401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.714161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.714485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.715312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.718268 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cded4f2-c518-4175-a8ce-82fe4bff5d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.719489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.720690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cded4f2-c518-4175-a8ce-82fe4bff5d99 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.720975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cded4f2-c518-4175-a8ce-82fe4bff5d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.721252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cded4f2-c518-4175-a8ce-82fe4bff5d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.723451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cded4f2-c518-4175-a8ce-82fe4bff5d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.724318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.726425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-9cded4f2-c518-4175-a8ce-82fe4bff5d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:01.726425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:01.726425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:01.727310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 16/33] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:01.728193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cded4f2-c518-4175-a8ce-82fe4bff5d99 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.753537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:01.766886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166071cc-887b-419e-8df2-1c3724482b66 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:01.773310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd586833-1085-4adf-b5b4-a47b6ddaf843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:01.774222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd586833-1085-4adf-b5b4-a47b6ddaf843 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.774596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd586833-1085-4adf-b5b4-a47b6ddaf843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.774889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd586833-1085-4adf-b5b4-a47b6ddaf843 admin admin] PATH_INFO: `/v3/domains/default/users/6fe756dac77c46179eda340982f2b52b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.777684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd586833-1085-4adf-b5b4-a47b6ddaf843 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6fe756dac77c46179eda340982f2b52b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:01.778883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-cd586833-1085-4adf-b5b4-a47b6ddaf843 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:01.778883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:01.778883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:01.781124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd586833-1085-4adf-b5b4-a47b6ddaf843 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:01.884846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 17/34] 10.222.0.11 () {58 vars in 1382 bytes} [Thu Nov 11 16:14:01 2021] PUT /identity/v3/domains/default/users/6fe756dac77c46179eda340982f2b52b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:01.890453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062169c-b8a4-48e2-ba8f-a132a6c32ccb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.891042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062169c-b8a4-48e2-ba8f-a132a6c32ccb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.891334 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062169c-b8a4-48e2-ba8f-a132a6c32ccb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.893489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 18/35] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:01 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:01.900294 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88213d2-c1ea-4622-870f-6743a05f5776 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:01.900650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88213d2-c1ea-4622-870f-6743a05f5776 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:01.900938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88213d2-c1ea-4622-870f-6743a05f5776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:01.926952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c88213d2-c1ea-4622-870f-6743a05f5776 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:01.928646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c88213d2-c1ea-4622-870f-6743a05f5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:02.014278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 19/36] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:02.040605 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 18/37] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:14:01 2021] POST /identity/v3/projects => generated 301 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:14:02.069713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88213d2-c1ea-4622-870f-6743a05f5776 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:02.083611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88213d2-c1ea-4622-870f-6743a05f5776 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:02.160145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8f20-5188-4910-86be-e91b2300d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:02.160919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8f20-5188-4910-86be-e91b2300d938 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.161126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8f20-5188-4910-86be-e91b2300d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.161407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8f20-5188-4910-86be-e91b2300d938 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.162214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8f20-5188-4910-86be-e91b2300d938 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:02.164080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8f20-5188-4910-86be-e91b2300d938 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:02.241109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 20/38] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:14:02 2021] POST /identity/v3/roles => generated 225 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:02.482865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0917be-26a3-4a4a-aa78-32d84b13f9d0 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.483950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0917be-26a3-4a4a-aa78-32d84b13f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.484027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0917be-26a3-4a4a-aa78-32d84b13f9d0 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.486055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 19/39] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:02.492541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256af50b-a1be-4e15-8e8c-cc131fca08f8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.492962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256af50b-a1be-4e15-8e8c-cc131fca08f8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.493362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256af50b-a1be-4e15-8e8c-cc131fca08f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.514046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-256af50b-a1be-4e15-8e8c-cc131fca08f8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:02.516173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-256af50b-a1be-4e15-8e8c-cc131fca08f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:02.527703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 21/40] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:02.559190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0917be-26a3-4a4a-aa78-32d84b13f9d0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:02.574019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0917be-26a3-4a4a-aa78-32d84b13f9d0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:02.578563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797528dc-b313-4ad6-b991-64e9eef3ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:02.579352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797528dc-b313-4ad6-b991-64e9eef3ca93 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.579641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797528dc-b313-4ad6-b991-64e9eef3ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.579918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797528dc-b313-4ad6-b991-64e9eef3ca93 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.581198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797528dc-b313-4ad6-b991-64e9eef3ca93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:02.583069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797528dc-b313-4ad6-b991-64e9eef3ca93 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:02.584658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 20/41] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:02.590780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256af50b-a1be-4e15-8e8c-cc131fca08f8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:02.600291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256af50b-a1be-4e15-8e8c-cc131fca08f8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:02.604620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03364f-7f32-4c76-afbd-35d10cc97746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:02.605266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03364f-7f32-4c76-afbd-35d10cc97746 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.605555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03364f-7f32-4c76-afbd-35d10cc97746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.605837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03364f-7f32-4c76-afbd-35d10cc97746 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.606593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03364f-7f32-4c76-afbd-35d10cc97746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:02.607612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-6a03364f-7f32-4c76-afbd-35d10cc97746 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:02.607612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:02.607612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:02.608895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03364f-7f32-4c76-afbd-35d10cc97746 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:02.677466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3eda-2df6-4c4c-904e-ded6dfe87b2e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.677767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3eda-2df6-4c4c-904e-ded6dfe87b2e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.678152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3eda-2df6-4c4c-904e-ded6dfe87b2e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.679986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 21/42] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:02.685496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a801a3-a606-48f8-b6d5-8571816e9e10 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.685790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a801a3-a606-48f8-b6d5-8571816e9e10 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.686108 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a801a3-a606-48f8-b6d5-8571816e9e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.704905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e8a801a3-a606-48f8-b6d5-8571816e9e10 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:02.706444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e8a801a3-a606-48f8-b6d5-8571816e9e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:02.714293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 22/43] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:02.722214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 22/44] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:14:02 2021] POST /identity/v3/projects => generated 312 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:02.742793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a801a3-a606-48f8-b6d5-8571816e9e10 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:02.753266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a801a3-a606-48f8-b6d5-8571816e9e10 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:02.821236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2865652-c01f-4c58-82f5-37a3761c0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:02.821926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2865652-c01f-4c58-82f5-37a3761c0a1f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:02.822233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2865652-c01f-4c58-82f5-37a3761c0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:02.822513 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2865652-c01f-4c58-82f5-37a3761c0a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:02.823297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2865652-c01f-4c58-82f5-37a3761c0a1f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:02.824383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-b2865652-c01f-4c58-82f5-37a3761c0a1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:02.824383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:02.824383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:02.825309 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2865652-c01f-4c58-82f5-37a3761c0a1f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:02.906218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 23/45] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:14:02 2021] POST /identity/v3/roles => generated 223 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:04.414033 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366175a-48fb-4a14-a330-85f5a097a2f6 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:04.414604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366175a-48fb-4a14-a330-85f5a097a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:04.414689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366175a-48fb-4a14-a330-85f5a097a2f6 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:04.416403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 23/46] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:04.423462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3b75f-670b-407e-938e-966edc6a88d7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:04.423846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3b75f-670b-407e-938e-966edc6a88d7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:04.424155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3b75f-670b-407e-938e-966edc6a88d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:04.443133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d0a3b75f-670b-407e-938e-966edc6a88d7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:04.444325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d0a3b75f-670b-407e-938e-966edc6a88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:04.452578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 24/47] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:04.477640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366175a-48fb-4a14-a330-85f5a097a2f6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:04.489759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366175a-48fb-4a14-a330-85f5a097a2f6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:04.494002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:04.494800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:04.495085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:04.495357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:04.506920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:04.514217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:04.515479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 24/48] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:04.521616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3b75f-670b-407e-938e-966edc6a88d7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:04.531512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3b75f-670b-407e-938e-966edc6a88d7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:04.536411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:04.537091 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:04.537387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:04.537672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:04.538518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:04.538804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:04.539820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:04.539820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:04.539820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:04.540740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:04.554608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 25/49] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:04.560387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:04.570632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118bf2-ccb7-45fa-9a70-a3de093a1906 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:04.574960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:04.575803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:04.576086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:04.576721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:04.577722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:04.579586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:04.581160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 25/50] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:04 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:04.586820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:04.596471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ae45a-24ab-4ae0-ba79-e85d4fcc944c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:04.600898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1e3b4-4096-4c25-9b21-0a0482f14da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:04.601705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1e3b4-4096-4c25-9b21-0a0482f14da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:04.601996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1e3b4-4096-4c25-9b21-0a0482f14da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:04.602310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1e3b4-4096-4c25-9b21-0a0482f14da2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:04.603542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1e3b4-4096-4c25-9b21-0a0482f14da2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:04.605297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1e3b4-4096-4c25-9b21-0a0482f14da2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:04.606925 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 26/51] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:04.613579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:04.623156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6215e12-8313-43ba-a8e9-026870275920 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:04.627465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:04.628106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:04.628390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:04.628667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:04.629510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.domain.id=default, user.id=6fe756dac77c46179eda340982f2b52b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:04.629818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:04.630886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:04.630886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:04.630886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:04.632040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50400fa3-4063-437f-a5bf-92fb0ca72e92 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:04.639527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 26/52] 10.222.0.11 () {56 vars in 1343 bytes} [Thu Nov 11 16:14:04 2021] GET /identity/v3/role_assignments?user.id=6fe756dac77c46179eda340982f2b52b&scope.domain.id=default&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:05.025618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb101-f17a-40c0-9c29-9e6ab8e79d81 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:05.025918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb101-f17a-40c0-9c29-9e6ab8e79d81 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:05.026306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb101-f17a-40c0-9c29-9e6ab8e79d81 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:05.028118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 27/53] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:05.033876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5532e-c0d8-45ee-812e-771a322a2649 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:05.034171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5532e-c0d8-45ee-812e-771a322a2649 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:05.034476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5532e-c0d8-45ee-812e-771a322a2649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:05.051962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-86e5532e-c0d8-45ee-812e-771a322a2649 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:05.053135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-86e5532e-c0d8-45ee-812e-771a322a2649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:05.061173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 27/54] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:05.086306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfb101-f17a-40c0-9c29-9e6ab8e79d81 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:05.098342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfb101-f17a-40c0-9c29-9e6ab8e79d81 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:05.102660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79132ba5-676c-4a43-aaa0-13e3dd004514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:05.103426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79132ba5-676c-4a43-aaa0-13e3dd004514 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:05.103742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79132ba5-676c-4a43-aaa0-13e3dd004514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:05.104026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79132ba5-676c-4a43-aaa0-13e3dd004514 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:05.105223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79132ba5-676c-4a43-aaa0-13e3dd004514 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:05.106985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79132ba5-676c-4a43-aaa0-13e3dd004514 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:05.108541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 28/55] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:05.114268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5532e-c0d8-45ee-812e-771a322a2649 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:05.123420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5532e-c0d8-45ee-812e-771a322a2649 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:05.127831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e6159-5a60-4c01-98a5-1059a7076e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:05.128491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e6159-5a60-4c01-98a5-1059a7076e18 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:05.128776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e6159-5a60-4c01-98a5-1059a7076e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:05.129050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e6159-5a60-4c01-98a5-1059a7076e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:05.129759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e6159-5a60-4c01-98a5-1059a7076e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:05.131721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e6159-5a60-4c01-98a5-1059a7076e18 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:05.220977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 28/56] 10.222.0.11 () {60 vars in 1161 bytes} [Thu Nov 11 16:14:05 2021] POST /identity/v3/projects => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:07.547620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fa62-4a4b-47a6-9528-7a9341f1f5b9 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:07.548087 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fa62-4a4b-47a6-9528-7a9341f1f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:07.548185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411fa62-4a4b-47a6-9528-7a9341f1f5b9 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:07.549942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 29/57] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:07.555807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a6b6-08c9-4bc3-8e22-819d2939d0b9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:07.556186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a6b6-08c9-4bc3-8e22-819d2939d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:07.556371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a6b6-08c9-4bc3-8e22-819d2939d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:07.574799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ade4a6b6-08c9-4bc3-8e22-819d2939d0b9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:07.576450 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ade4a6b6-08c9-4bc3-8e22-819d2939d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:07.631889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 29/58] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:07.659330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411fa62-4a4b-47a6-9528-7a9341f1f5b9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:07.671802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411fa62-4a4b-47a6-9528-7a9341f1f5b9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:07.676063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc238b80-d53e-47ed-a029-f3f7e47944af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:07.676835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc238b80-d53e-47ed-a029-f3f7e47944af admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:07.677124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc238b80-d53e-47ed-a029-f3f7e47944af admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:07.677406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc238b80-d53e-47ed-a029-f3f7e47944af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:07.678624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc238b80-d53e-47ed-a029-f3f7e47944af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:07.680324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc238b80-d53e-47ed-a029-f3f7e47944af admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:07.681896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 30/59] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:07.688066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a6b6-08c9-4bc3-8e22-819d2939d0b9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:07.696817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a6b6-08c9-4bc3-8e22-819d2939d0b9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:07.701287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142806a9-be7a-49ed-8f4d-aa55e52d36ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:07.701935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142806a9-be7a-49ed-8f4d-aa55e52d36ed admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:07.702253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142806a9-be7a-49ed-8f4d-aa55e52d36ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:07.702535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142806a9-be7a-49ed-8f4d-aa55e52d36ed admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:07.703270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142806a9-be7a-49ed-8f4d-aa55e52d36ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:07.704311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-142806a9-be7a-49ed-8f4d-aa55e52d36ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:07.704311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:07.704311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:07.705550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142806a9-be7a-49ed-8f4d-aa55e52d36ed admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:07.824444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 30/60] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:07 2021] POST /identity/v3/users => generated 275 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:14:11.202785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043268f8-71ac-432c-9dd0-fb10fa33597d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.203293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043268f8-71ac-432c-9dd0-fb10fa33597d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.203390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043268f8-71ac-432c-9dd0-fb10fa33597d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.205134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 31/61] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:11.211303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799c34b-36ec-49e1-ba0e-81968718cc2f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.211690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799c34b-36ec-49e1-ba0e-81968718cc2f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.211876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799c34b-36ec-49e1-ba0e-81968718cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.243173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d799c34b-36ec-49e1-ba0e-81968718cc2f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:11.244379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d799c34b-36ec-49e1-ba0e-81968718cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:11.252521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 31/62] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:11.279128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043268f8-71ac-432c-9dd0-fb10fa33597d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.296967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043268f8-71ac-432c-9dd0-fb10fa33597d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.308203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.309167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.309417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.309708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.326732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:11.334094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:11.335427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 32/63] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:11.343057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799c34b-36ec-49e1-ba0e-81968718cc2f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.352251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799c34b-36ec-49e1-ba0e-81968718cc2f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.358791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.359838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.360318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.360814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.361804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:11.362352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.364260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.384782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 32/64] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.391455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.407784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66ca01-6106-48c0-893a-6f7785cf4c7d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.414255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a68f05-28d3-4bf1-8cf7-c0b17b39c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.415133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68f05-28d3-4bf1-8cf7-c0b17b39c568 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.415423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68f05-28d3-4bf1-8cf7-c0b17b39c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.415702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a68f05-28d3-4bf1-8cf7-c0b17b39c568 admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.443903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a68f05-28d3-4bf1-8cf7-c0b17b39c568 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.446104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a68f05-28d3-4bf1-8cf7-c0b17b39c568 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.447874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 33/65] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.454876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.467217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd2c5-a7f2-4c87-b386-fe10650beac2 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.467721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd2c5-a7f2-4c87-b386-fe10650beac2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.468152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd2c5-a7f2-4c87-b386-fe10650beac2 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.470085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 34/66] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:11.472515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e989-913e-46b0-85bc-dbfaf580df81 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.476219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a250b-5a3c-4422-8bb4-97d87a4f4921 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.476673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a250b-5a3c-4422-8bb4-97d87a4f4921 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.477104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a250b-5a3c-4422-8bb4-97d87a4f4921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.477434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.478345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.478904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.479378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.490658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.497523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.508759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a32a250b-5a3c-4422-8bb4-97d87a4f4921 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:11.510421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a32a250b-5a3c-4422-8bb4-97d87a4f4921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:11.514066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 33/67] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:11.523100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.527190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 35/68] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:11.536396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efbadf-b2b2-4504-835d-5f2853d7875c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.545535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab4d7-9361-4a7e-a015-68a5ff99281f None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.545826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab4d7-9361-4a7e-a015-68a5ff99281f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.548063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab4d7-9361-4a7e-a015-68a5ff99281f None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.548063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 36/69] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:11.554363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ab4d7-9361-4a7e-a015-68a5ff99281f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.555901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25fbd4-f3b3-4a28-acd4-a6120685a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.557032 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fbd4-f3b3-4a28-acd4-a6120685a5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.557505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fbd4-f3b3-4a28-acd4-a6120685a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.557956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fbd4-f3b3-4a28-acd4-a6120685a5a3 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.559594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25fbd4-f3b3-4a28-acd4-a6120685a5a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.561983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25fbd4-f3b3-4a28-acd4-a6120685a5a3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.564113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 34/70] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.565732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdf95-071d-4997-829e-2dcb461da96f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.566211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdf95-071d-4997-829e-2dcb461da96f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.566698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bdf95-071d-4997-829e-2dcb461da96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.568385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ab4d7-9361-4a7e-a015-68a5ff99281f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.573305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.574593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.575111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.575612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.587872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cc8bdf95-071d-4997-829e-2dcb461da96f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:11.589100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cc8bdf95-071d-4997-829e-2dcb461da96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:11.592022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:11.597876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 35/71] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:11.598803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bdf95-071d-4997-829e-2dcb461da96f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.600403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:11.601812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 37/72] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:11.608366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.611636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bdf95-071d-4997-829e-2dcb461da96f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.616269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.616972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.617437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.617881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.618925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=549aab745e5b401181e0ecf7c85c05fe, user.id=3c084d344b7b4433be0a9b2c80d5f23c) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:11.619428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.619651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92fb4d-e45b-490c-b906-3d034d83334e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.622380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.628896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 36/73] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/role_assignments?user.id=3c084d344b7b4433be0a9b2c80d5f23c&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.630029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.634896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.635580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.635866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.636144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.637240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:11.637551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.639354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.641544 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919e26e-8d90-42c3-a2b5-d15e84539e44 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.646419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.647803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.648291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.648760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.657513 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 38/74] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:11.661512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:11.663861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.669539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:11.671277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 37/75] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:11.685250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e8c0-5a95-4816-a04a-0edda2b1a175 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.690612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.691992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.693535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.696082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.696600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.702679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.705347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.710365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 39/76] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.713338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f519-76a6-4e3e-b22f-2e4db98c38e5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.721037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.722818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.723523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.723818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.724103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.724983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:11.725305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.727096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.739497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d711d4-1755-45c0-9d12-169c7b219d96 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.744531 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 38/77] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:11.748767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.749444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.749734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.750015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.751633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.768903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb2a0-8059-4a55-9156-d8d429ca10eb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.769738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.772188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.774479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4622f-89de-471a-9e8d-49303c109ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.775545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4622f-89de-471a-9e8d-49303c109ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.775978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4622f-89de-471a-9e8d-49303c109ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.776401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4622f-89de-471a-9e8d-49303c109ee2 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.778759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4622f-89de-471a-9e8d-49303c109ee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.780789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4622f-89de-471a-9e8d-49303c109ee2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.782763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 39/78] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.783721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 40/79] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:11.784545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270116-6588-4326-8600-2925e5942f25 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.789851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270116-6588-4326-8600-2925e5942f25 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.790018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.790652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270116-6588-4326-8600-2925e5942f25 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.793458 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 40/80] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:11 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:11.794489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80270116-6588-4326-8600-2925e5942f25 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.803583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3fae1-befe-43e0-b3a8-ac85bcd8b424 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.808696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.809622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.810089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.810587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.811523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80270116-6588-4326-8600-2925e5942f25 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.816663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3cbaa-2f40-4956-95e8-fd9c92f66bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.817528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3cbaa-2f40-4956-95e8-fd9c92f66bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.818467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3cbaa-2f40-4956-95e8-fd9c92f66bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.818750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3cbaa-2f40-4956-95e8-fd9c92f66bb0 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.820360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3cbaa-2f40-4956-95e8-fd9c92f66bb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.820921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.822520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3cbaa-2f40-4956-95e8-fd9c92f66bb0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.823219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.824455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 41/81] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.831136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdef8c-2559-4300-a99c-356ac7e5ccf7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.831136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdef8c-2559-4300-a99c-356ac7e5ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.831136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdef8c-2559-4300-a99c-356ac7e5ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.845714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 41/82] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:11.846100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-03fdef8c-2559-4300-a99c-356ac7e5ccf7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:11.846597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.847908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-03fdef8c-2559-4300-a99c-356ac7e5ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:11.856507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 42/83] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:11.857519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be334-7798-4d30-a75f-c14c63a6de0c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.857801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdef8c-2559-4300-a99c-356ac7e5ccf7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.874227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdef8c-2559-4300-a99c-356ac7e5ccf7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.878306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.879208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.879675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.880133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.882070 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] RBAC: Adding query filter params (role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=549aab745e5b401181e0ecf7c85c05fe, user.id=3c084d344b7b4433be0a9b2c80d5f23c) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:11.883095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.885638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.886928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc9984-c4c1-42b0-a4a1-7a4488f6cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.887808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9984-c4c1-42b0-a4a1-7a4488f6cd8d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.888092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9984-c4c1-42b0-a4a1-7a4488f6cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.888368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9984-c4c1-42b0-a4a1-7a4488f6cd8d admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.890713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc9984-c4c1-42b0-a4a1-7a4488f6cd8d admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.892755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc9984-c4c1-42b0-a4a1-7a4488f6cd8d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.893673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 42/84] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/role_assignments?user.id=3c084d344b7b4433be0a9b2c80d5f23c&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=019207b971e242a29fd501b9b5a887f8 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.894443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.898214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 43/85] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.898214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73cdf-c989-415c-a4dd-7c2b41acf3c7 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.898214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73cdf-c989-415c-a4dd-7c2b41acf3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.898214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73cdf-c989-415c-a4dd-7c2b41acf3c7 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.899354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 44/86] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:11.908695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a26db-15b4-48f3-bf21-573cea65f0d5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.908997 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a26db-15b4-48f3-bf21-573cea65f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.909341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a26db-15b4-48f3-bf21-573cea65f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.912859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a037a-2051-48a9-a78e-d0e1630f554c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.918508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.919552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.919963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.920405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.921901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.923823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.925712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 43/87] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.926731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.929522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-909a26db-15b4-48f3-bf21-573cea65f0d5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:11.930797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-909a26db-15b4-48f3-bf21-573cea65f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:11.938277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c07d-1992-4d39-a3a6-530a9aec19e5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.942251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 45/88] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:11.943368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a26db-15b4-48f3-bf21-573cea65f0d5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.950128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.951090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.951545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.951960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.954517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=549aab745e5b401181e0ecf7c85c05fe, user.id=6fe756dac77c46179eda340982f2b52b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:11.954991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.957946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.965224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a26db-15b4-48f3-bf21-573cea65f0d5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.971375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 44/89] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/role_assignments?user.id=6fe756dac77c46179eda340982f2b52b&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:11.977494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:11.987055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.987722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.988073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.988288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:11.989101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:11.990968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a41d3-e38a-49cc-a8fc-3d5de504659d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:11.991116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:11.996556 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:11.997794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:11.998381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:11.998917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:12.013466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:12.021342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:12.023674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 45/90] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:12.030792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:12.043499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1e06-5d85-4c74-ae8d-83e54b86a6c9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:12.049156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:12.050287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:12.050802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:12.051287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:12.052331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:12.052954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:12.055151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:12.066073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 46/91] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:12.072780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:12.084307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7d34-6571-4b41-9aab-7ab6c7633c62 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:12.089502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:12.090600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:12.091056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:12.091446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:12.092931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:12.095331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:12.097254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 47/92] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:12 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:12.103676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:12.111849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 46/93] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:14:11 2021] POST /identity/v3/projects => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:12.115244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfdd33-eda4-48c8-a854-1f8785aaabfe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:12.181994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:12.182871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:12.183351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:12.183962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:12.192941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:12.195062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:12.206379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 48/94] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:14:12.213293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:12.224658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303d619-5d73-403d-8a5b-7b2bbfe7278c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:12.229516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7253b80-330b-4403-a509-93d33d91e8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:12.230474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253b80-330b-4403-a509-93d33d91e8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:12.230814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253b80-330b-4403-a509-93d33d91e8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:12.231105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253b80-330b-4403-a509-93d33d91e8e5 admin admin] PATH_INFO: `/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:12.232436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253b80-330b-4403-a509-93d33d91e8e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=21cb8c562b7e4e5fb19de7911fc021bb)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:12.234676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253b80-330b-4403-a509-93d33d91e8e5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:12.236502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 47/95] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:12 2021] GET /identity/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:12.243347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:12.253107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981baf7-dd03-47b0-8afa-a17ea044cb1e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:12.257764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0aa38-7528-4ae9-b9bb-710c732ecc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:12.258522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0aa38-7528-4ae9-b9bb-710c732ecc1a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:12.258814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0aa38-7528-4ae9-b9bb-710c732ecc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:12.259100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0aa38-7528-4ae9-b9bb-710c732ecc1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:12.259967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0aa38-7528-4ae9-b9bb-710c732ecc1a admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=21cb8c562b7e4e5fb19de7911fc021bb, user.id=3c084d344b7b4433be0a9b2c80d5f23c) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:12.260287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0aa38-7528-4ae9-b9bb-710c732ecc1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:12.263019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0aa38-7528-4ae9-b9bb-710c732ecc1a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:12.269623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 49/96] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:12 2021] GET /identity/v3/role_assignments?user.id=3c084d344b7b4433be0a9b2c80d5f23c&scope.project.id=21cb8c562b7e4e5fb19de7911fc021bb&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:14.331858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee24505-8488-4d5f-b920-4ef55643b16d None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.332390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee24505-8488-4d5f-b920-4ef55643b16d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.332390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee24505-8488-4d5f-b920-4ef55643b16d None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.334402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 48/97] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:14.352507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62d01-cee2-4c22-b85c-7c510f8970c0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.352993 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62d01-cee2-4c22-b85c-7c510f8970c0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.353062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62d01-cee2-4c22-b85c-7c510f8970c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.379181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-46f62d01-cee2-4c22-b85c-7c510f8970c0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:14.380404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-46f62d01-cee2-4c22-b85c-7c510f8970c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:14.392656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 50/98] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:14.428591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee24505-8488-4d5f-b920-4ef55643b16d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:14.444022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee24505-8488-4d5f-b920-4ef55643b16d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:14.449134 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:14.449919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.450224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.450507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.471111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:14.478069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:14.479865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 49/99] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:14.486845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62d01-cee2-4c22-b85c-7c510f8970c0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:14.496338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62d01-cee2-4c22-b85c-7c510f8970c0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:14.506385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:14.507066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.507359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.507645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.508431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:14.508745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:14.510944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:14.527323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 51/100] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:14.534910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:14.547731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2c0da-98b2-4571-a6d6-f6570b9da884 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:14.554233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:14.555130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.555418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.555701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.557128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:14.559664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:14.561729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 50/101] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:14 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:14.567724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:14.586000 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd378da9-df17-4877-b9e6-55b1dd66b797 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:14.594385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd0604-f63f-4be2-9618-a2cc9f9568b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:14.595251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd0604-f63f-4be2-9618-a2cc9f9568b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.595540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd0604-f63f-4be2-9618-a2cc9f9568b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.595818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd0604-f63f-4be2-9618-a2cc9f9568b3 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.602983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd0604-f63f-4be2-9618-a2cc9f9568b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:14.605792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd0604-f63f-4be2-9618-a2cc9f9568b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:14.607797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 52/102] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:14 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:14.613868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:14.627152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbd3cb-3569-4dc6-9230-1dc6fc941a15 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:14.634299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:14.635190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.635676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.635988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe/users/3c084d344b7b4433be0a9b2c80d5f23c/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.643548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549aab745e5b401181e0ecf7c85c05fe, user_id=3c084d344b7b4433be0a9b2c80d5f23c, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:14.646537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:14.723796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70b6a2-7698-4ed1-ab18-8ecb1c6aa7db None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.724096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70b6a2-7698-4ed1-ab18-8ecb1c6aa7db None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.724361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70b6a2-7698-4ed1-ab18-8ecb1c6aa7db None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.726150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 53/103] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:14.732829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476140-bd83-45df-aec7-421db608446c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.733323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476140-bd83-45df-aec7-421db608446c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.733752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80476140-bd83-45df-aec7-421db608446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.736197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 51/104] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:14 2021] PUT /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe/users/3c084d344b7b4433be0a9b2c80d5f23c/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:14.762746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-80476140-bd83-45df-aec7-421db608446c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:14.764215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-80476140-bd83-45df-aec7-421db608446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:14.860987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 54/105] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:14.909099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:14.923740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ee5da-ef7d-4cca-8348-1a0f520f0781 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:14.935417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db93031-9149-4e70-a92d-4138fe73859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:14.936235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93031-9149-4e70-a92d-4138fe73859b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.936523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93031-9149-4e70-a92d-4138fe73859b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.936804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db93031-9149-4e70-a92d-4138fe73859b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.955847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db93031-9149-4e70-a92d-4138fe73859b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:14.962874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1db93031-9149-4e70-a92d-4138fe73859b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:14.964169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 52/106] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:14.970828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80476140-bd83-45df-aec7-421db608446c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:14.981914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5abad7-0045-4b9c-ab56-024137e770c4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.982268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5abad7-0045-4b9c-ab56-024137e770c4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.982505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5abad7-0045-4b9c-ab56-024137e770c4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:14.984309 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 53/107] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:14.990371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80476140-bd83-45df-aec7-421db608446c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:14.990817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0600837-5574-4ffd-8a5e-73c07ec42250 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:14.991101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0600837-5574-4ffd-8a5e-73c07ec42250 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:14.991380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0600837-5574-4ffd-8a5e-73c07ec42250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.006208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.007306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.007796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.008272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.009283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:15.012134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.014070 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.037526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f0600837-5574-4ffd-8a5e-73c07ec42250 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:15.039357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f0600837-5574-4ffd-8a5e-73c07ec42250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:15.042047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 55/108] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.052197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.063404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 54/109] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:15.064579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f32b-a16e-46f7-b667-ad32713bf4f7 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.064876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f32b-a16e-46f7-b667-ad32713bf4f7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.065160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f32b-a16e-46f7-b667-ad32713bf4f7 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.066112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42248380-1fb9-4602-b0f5-fab6b84f6991 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.067184 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 55/110] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:15.073548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a770-bacd-41a5-bd6f-d34d2dcfc94f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.073548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a770-bacd-41a5-bd6f-d34d2dcfc94f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.073963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a770-bacd-41a5-bd6f-d34d2dcfc94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.074558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.075889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.076469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.076946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.078517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.080674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.082830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 56/111] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.089956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.094204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d512a770-bacd-41a5-bd6f-d34d2dcfc94f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:15.095537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d512a770-bacd-41a5-bd6f-d34d2dcfc94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:15.102579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ca48b-97e6-4ab2-b1d4-0a3856e1f215 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.103711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 56/112] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:15.109533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.110915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.111430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512a770-bacd-41a5-bd6f-d34d2dcfc94f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.111551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.111731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.114552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.116715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.118623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 57/113] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:15.125361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512a770-bacd-41a5-bd6f-d34d2dcfc94f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.127723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.131039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.132173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.132654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.133158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.139790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad9fb6-6f7c-4417-8f29-b4d19c0c3977 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.144446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.145353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.145894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.146193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe/users/6fe756dac77c46179eda340982f2b52b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.148206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549aab745e5b401181e0ecf7c85c05fe, user_id=6fe756dac77c46179eda340982f2b52b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.148943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:15.149255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:15.149255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:15.149255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:15.153329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.157475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:15.158918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 57/114] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:15.159610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.171163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1a15f-b05b-41b3-a3c9-afd06b2e2579 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.175553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.176344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.176635 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.176908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.188632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:15.195743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:15.197248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 58/115] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:15.199097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.208467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8035e-d069-4f5d-aa76-d99f8c6ce2a9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.212877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.214165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.214467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.214889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.215663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:15.215968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.217591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.226138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 59/116] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.226846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.237982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd6a4-8bd3-4787-ac2d-c0890f101af1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.242636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd06229-7e39-4bb1-91b3-6829e9a14fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.243293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd06229-7e39-4bb1-91b3-6829e9a14fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.243681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd06229-7e39-4bb1-91b3-6829e9a14fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.243955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd06229-7e39-4bb1-91b3-6829e9a14fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.244930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd06229-7e39-4bb1-91b3-6829e9a14fb4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:15.245480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd06229-7e39-4bb1-91b3-6829e9a14fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.246929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd06229-7e39-4bb1-91b3-6829e9a14fb4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.248578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 58/117] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:15 2021] PUT /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe/users/6fe756dac77c46179eda340982f2b52b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:14:15.256472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.265128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 60/118] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.268482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c9b1-701a-4617-9dd4-410f7a8f6b29 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.268782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c9b1-701a-4617-9dd4-410f7a8f6b29 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.269574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c9b1-701a-4617-9dd4-410f7a8f6b29 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.272786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 61/119] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:15.273476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c9b1-701a-4617-9dd4-410f7a8f6b29 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.347469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533510-5da1-4a27-abb5-791af79e6a70 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.349321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c9b1-701a-4617-9dd4-410f7a8f6b29 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.356184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbeffb-b18e-4e45-b1d7-56265f079cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.357073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.357191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbeffb-b18e-4e45-b1d7-56265f079cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.357359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbeffb-b18e-4e45-b1d7-56265f079cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.357629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbeffb-b18e-4e45-b1d7-56265f079cb2 admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.358385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.358680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.358910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbeffb-b18e-4e45-b1d7-56265f079cb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.359002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.360304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.361149 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbeffb-b18e-4e45-b1d7-56265f079cb2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.362916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.363204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 59/120] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.364708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc9dfc-25d2-4747-812e-1a5f1f2ddc79 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.364835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 62/121] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.364919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc9dfc-25d2-4747-812e-1a5f1f2ddc79 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.365164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc9dfc-25d2-4747-812e-1a5f1f2ddc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.370606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.382129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd86ed-5d89-44f4-9d38-e6e7cfe9c11d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.386953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.387824 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.388117 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.388400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.389722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.389967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-12bc9dfc-25d2-4747-812e-1a5f1f2ddc79 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:15.391293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-12bc9dfc-25d2-4747-812e-1a5f1f2ddc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:15.391875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.394018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 63/122] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.394932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.402291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 60/123] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:15.403899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc9dfc-25d2-4747-812e-1a5f1f2ddc79 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.406801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a840b7b-3d69-4957-aed1-0656659b84ca admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.411871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.412846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.413136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.413416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] PATH_INFO: `/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.413713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc9dfc-25d2-4747-812e-1a5f1f2ddc79 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.415097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] RBAC: Authorizing `identity:get_project(project_id=21cb8c562b7e4e5fb19de7911fc021bb)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.418707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.419364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.420268 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.420551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.421037 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 64/124] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.421282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe/users/3c084d344b7b4433be0a9b2c80d5f23c/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.427474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.433465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549aab745e5b401181e0ecf7c85c05fe, user_id=3c084d344b7b4433be0a9b2c80d5f23c, role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.437524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.439491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2e88e-d4ce-4998-93ce-a249653e8814 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.450272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.450272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.450272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.450272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] PATH_INFO: `/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb/users/3c084d344b7b4433be0a9b2c80d5f23c/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.450855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cb8c562b7e4e5fb19de7911fc021bb, user_id=3c084d344b7b4433be0a9b2c80d5f23c, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.452095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.531926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 61/125] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:15 2021] PUT /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe/users/3c084d344b7b4433be0a9b2c80d5f23c/roles/019207b971e242a29fd501b9b5a887f8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:15.533183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.557913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 65/126] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:15 2021] PUT /identity/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb/users/3c084d344b7b4433be0a9b2c80d5f23c/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:15.633485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5728ad-7b7d-44a8-86cd-363de1237438 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.698487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d852-6d10-4867-8541-7a15c6ccd744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.699382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d852-6d10-4867-8541-7a15c6ccd744 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.699677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d852-6d10-4867-8541-7a15c6ccd744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.699966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d852-6d10-4867-8541-7a15c6ccd744 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.701328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d852-6d10-4867-8541-7a15c6ccd744 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.703143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d852-6d10-4867-8541-7a15c6ccd744 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.705253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 62/127] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:15.711522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:15.722902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021981-f33b-494a-9cec-26192fe2f7c9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:15.727684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30a34d-2212-49a2-bbc0-1a1ae71a9c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:15.728430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a34d-2212-49a2-bbc0-1a1ae71a9c47 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:15.728721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a34d-2212-49a2-bbc0-1a1ae71a9c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:15.729580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a34d-2212-49a2-bbc0-1a1ae71a9c47 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:15.730394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30a34d-2212-49a2-bbc0-1a1ae71a9c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:15.732557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30a34d-2212-49a2-bbc0-1a1ae71a9c47 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:15.830051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 66/128] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:15 2021] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:17.664233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20285ac0-388a-4f16-97b5-4ded1f4b2d17 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:17.664755 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20285ac0-388a-4f16-97b5-4ded1f4b2d17 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:17.664830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20285ac0-388a-4f16-97b5-4ded1f4b2d17 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:17.667302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 63/129] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:17.673351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a419e6-500c-4898-8ddb-cac2277a14f4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:17.674260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a419e6-500c-4898-8ddb-cac2277a14f4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:17.674765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a419e6-500c-4898-8ddb-cac2277a14f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:17.699151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-90a419e6-500c-4898-8ddb-cac2277a14f4 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:17.700694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-90a419e6-500c-4898-8ddb-cac2277a14f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:17.714368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 67/130] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:17.760909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20285ac0-388a-4f16-97b5-4ded1f4b2d17 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:17.787923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20285ac0-388a-4f16-97b5-4ded1f4b2d17 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:17.798418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:17.799524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:17.800034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:17.800511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:17.822972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:17.830335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:17.831772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 64/131] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:17.841336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a419e6-500c-4898-8ddb-cac2277a14f4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:17.864661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a419e6-500c-4898-8ddb-cac2277a14f4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:17.879744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:17.880792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:17.881337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:17.881820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:17.882865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:17.883402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:17.885368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:17.897781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 68/132] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:17.904899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:17.924380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66be58-221e-42de-bc03-a4e65354b7d6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:17.930213 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:17.931913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:17.932412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:17.933038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:17.939029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:17.941619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:17.943552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 65/133] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:17 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:17.950290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:17.963549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3727d8-7d2a-4273-83b8-9b48ce72eaff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:17.971687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:17.972629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:17.973118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:17.973592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:17.987094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:17.989191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.001520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 69/134] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:18.008021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.022292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeff566-88e6-4656-8c9d-11d7694c2ec1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.030572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340ecaa-f484-4fff-8b02-ac18d9d5f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.031841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340ecaa-f484-4fff-8b02-ac18d9d5f16a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.032339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340ecaa-f484-4fff-8b02-ac18d9d5f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.032822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340ecaa-f484-4fff-8b02-ac18d9d5f16a admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.034254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340ecaa-f484-4fff-8b02-ac18d9d5f16a admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.036650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340ecaa-f484-4fff-8b02-ac18d9d5f16a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.039098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 66/135] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.045877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.056600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c3d2-d4db-4790-adad-0228b0903010 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.063404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.064369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.064945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.065438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.066687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=549aab745e5b401181e0ecf7c85c05fe, user.id=3c084d344b7b4433be0a9b2c80d5f23c) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:18.067234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.071032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b1da-b272-4935-8041-e3f842dc9254 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.071561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b1da-b272-4935-8041-e3f842dc9254 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.072772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b1da-b272-4935-8041-e3f842dc9254 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.074857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 67/136] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:18.075170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.082959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 70/137] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/role_assignments?user.id=3c084d344b7b4433be0a9b2c80d5f23c&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.086786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec0f9-4cb1-4f23-884a-dcda35bcb32c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.087326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec0f9-4cb1-4f23-884a-dcda35bcb32c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.088426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec0f9-4cb1-4f23-884a-dcda35bcb32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.119655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a99ec0f9-4cb1-4f23-884a-dcda35bcb32c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:18.120948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a99ec0f9-4cb1-4f23-884a-dcda35bcb32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:18.143222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 68/138] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:18.203772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.220684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0206c4-7986-460e-b28e-a9c767c223db admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.230769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.231577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.231866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.232201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.251619 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:18.261332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:18.263212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 71/139] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:18.277554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec0f9-4cb1-4f23-884a-dcda35bcb32c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.301109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec0f9-4cb1-4f23-884a-dcda35bcb32c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.307383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.308087 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.308381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.308666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.309484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:18.309798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.313772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.329474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 69/140] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:18.342361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.358618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5881a-d4f6-46b9-a90e-d837bc69ba20 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.368263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.369491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.369824 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.370109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.371544 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.373520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.375394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 72/141] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.381581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.392331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ae659-ac07-449b-8d74-cfb4678d9f27 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.398964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.399641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.400617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.400937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.410988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.412915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.427519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 70/142] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:18.433691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.444001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc93c41-f983-4fb9-a4c7-578940ed0575 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.453242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a6b34-ee10-4e7a-a01b-a816c5a73a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.454223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a6b34-ee10-4e7a-a01b-a816c5a73a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.454484 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a6b34-ee10-4e7a-a01b-a816c5a73a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.454768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a6b34-ee10-4e7a-a01b-a816c5a73a13 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.456048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a6b34-ee10-4e7a-a01b-a816c5a73a13 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.458284 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a6b34-ee10-4e7a-a01b-a816c5a73a13 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.460197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 73/143] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.468626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.478041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ae00d-e109-42f2-aa1f-feea0bf45841 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.484181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5f271-3c5e-4ff6-84e5-6e6cae036457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.484844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5f271-3c5e-4ff6-84e5-6e6cae036457 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.485148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5f271-3c5e-4ff6-84e5-6e6cae036457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.485461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5f271-3c5e-4ff6-84e5-6e6cae036457 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.486454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5f271-3c5e-4ff6-84e5-6e6cae036457 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=549aab745e5b401181e0ecf7c85c05fe, user.id=6fe756dac77c46179eda340982f2b52b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:18.486824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5f271-3c5e-4ff6-84e5-6e6cae036457 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.488809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5f271-3c5e-4ff6-84e5-6e6cae036457 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.495575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 71/144] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/role_assignments?user.id=6fe756dac77c46179eda340982f2b52b&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.583740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2469-0d3c-4d6d-94c5-a74f84f86168 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.584040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2469-0d3c-4d6d-94c5-a74f84f86168 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.584222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2469-0d3c-4d6d-94c5-a74f84f86168 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.586032 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 74/145] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:18.593859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4310a4-d2a1-442a-a69b-013e9ee4d1f5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.594166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4310a4-d2a1-442a-a69b-013e9ee4d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.594456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4310a4-d2a1-442a-a69b-013e9ee4d1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.617915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0c4310a4-d2a1-442a-a69b-013e9ee4d1f5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:18.623521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0c4310a4-d2a1-442a-a69b-013e9ee4d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:18.632275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 72/146] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:18.681427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2469-0d3c-4d6d-94c5-a74f84f86168 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.694296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2469-0d3c-4d6d-94c5-a74f84f86168 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.700694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.701558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.701846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.702123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.714489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:18.722005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:18.723667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 75/147] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:18.731511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4310a4-d2a1-442a-a69b-013e9ee4d1f5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.741233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4310a4-d2a1-442a-a69b-013e9ee4d1f5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.749256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.750007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.750318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.750648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.751450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:18.751763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.753596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.764177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 73/148] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.771803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.787539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906be7f9-8807-4c1d-bd2e-a6e1be83db25 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.792183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.793061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.793347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.793625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.799034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.801255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.803316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 76/149] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.809952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.820222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0df86-a925-4dcc-938c-89f5602ff888 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.830492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de60e-0803-4ce8-a6c9-cbd3731194bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.831171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de60e-0803-4ce8-a6c9-cbd3731194bf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.831460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de60e-0803-4ce8-a6c9-cbd3731194bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.831740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de60e-0803-4ce8-a6c9-cbd3731194bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.841281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de60e-0803-4ce8-a6c9-cbd3731194bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.843103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de60e-0803-4ce8-a6c9-cbd3731194bf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.854730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 74/150] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:18.860639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.875127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988a1f3-58ce-47e4-95ac-544e58144517 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.880101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.880964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.881250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.881528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.887023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.889160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.891158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 77/151] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.896835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e556ad6-c25a-4065-8d49-99742c22b8df None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.897130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e556ad6-c25a-4065-8d49-99742c22b8df None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.897410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e556ad6-c25a-4065-8d49-99742c22b8df None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.899247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 75/152] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:18.900351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.908209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d3746-b76e-4449-a1a7-00b74c5d09fb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.908499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d3746-b76e-4449-a1a7-00b74c5d09fb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.908786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d3746-b76e-4449-a1a7-00b74c5d09fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.935310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4a1d3746-b76e-4449-a1a7-00b74c5d09fb None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:18.935600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247412-3aa6-401d-8cc7-379c245de46c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:18.936493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4a1d3746-b76e-4449-a1a7-00b74c5d09fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:18.943158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:18.943811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:18.944089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:18.944363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:18.945210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] RBAC: Adding query filter params (role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=549aab745e5b401181e0ecf7c85c05fe, user.id=3c084d344b7b4433be0a9b2c80d5f23c) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:18.945517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:18.948532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:18.962351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 76/153] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:18.966034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 78/154] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/role_assignments?user.id=3c084d344b7b4433be0a9b2c80d5f23c&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=019207b971e242a29fd501b9b5a887f8 => generated 608 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:18.986365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d3746-b76e-4449-a1a7-00b74c5d09fb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:18.995777 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d3746-b76e-4449-a1a7-00b74c5d09fb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:19.007494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:19.008311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:19.008599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:19.008875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:19.024089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:19.032779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:19.034041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 77/155] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:19.040654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:19.050605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a9054-f274-42c3-a005-bac44b5c5c69 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:19.059463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:19.060135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:19.060414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:19.060686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:19.061461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:19.061954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:19.063671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:19.075680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 79/156] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:19.082256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:19.092178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68693340-576b-4ae0-a850-811c45c85e23 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:19.099396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:19.100300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:19.100588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:19.100873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:19.103002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:19.105884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:19.107746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 78/157] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:19 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:19.123806 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:19.140350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31a932-c89e-4ad1-ac29-c20b8404d55f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:19.149726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:19.150408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:19.150669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:19.150944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:19.162572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:19.164369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:19.180145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 80/158] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:19.187271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:19.204023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c92791-8725-49f4-b643-f10bb2eb54bb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:19.218933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d537dea-52da-475b-9042-87dcadd478e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:19.219818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537dea-52da-475b-9042-87dcadd478e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:19.220105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537dea-52da-475b-9042-87dcadd478e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:19.220386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537dea-52da-475b-9042-87dcadd478e2 admin admin] PATH_INFO: `/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:19.221690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d537dea-52da-475b-9042-87dcadd478e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=21cb8c562b7e4e5fb19de7911fc021bb)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:19.223795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d537dea-52da-475b-9042-87dcadd478e2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:19.225489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 79/159] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:19 2021] GET /identity/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb => generated 312 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:19.233000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:19.243967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7a58-4d5d-4a7c-9991-a6b1c2c6e24c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:19.250617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb51c7-30ed-466e-93db-8334c615169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:19.251265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb51c7-30ed-466e-93db-8334c615169c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:19.251542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb51c7-30ed-466e-93db-8334c615169c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:19.251815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb51c7-30ed-466e-93db-8334c615169c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:19.252658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb51c7-30ed-466e-93db-8334c615169c admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=21cb8c562b7e4e5fb19de7911fc021bb, user.id=3c084d344b7b4433be0a9b2c80d5f23c) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:19.252970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb51c7-30ed-466e-93db-8334c615169c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:19.254854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb51c7-30ed-466e-93db-8334c615169c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:19.267126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 81/160] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:19 2021] GET /identity/v3/role_assignments?user.id=3c084d344b7b4433be0a9b2c80d5f23c&scope.project.id=21cb8c562b7e4e5fb19de7911fc021bb&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:20.324190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abbb9-6118-4347-ae58-430a15040331 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.324895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abbb9-6118-4347-ae58-430a15040331 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.324895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abbb9-6118-4347-ae58-430a15040331 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.326544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 80/161] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:20.332416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50f96-6bdb-4c28-b05c-1ef6bd06991d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.332905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50f96-6bdb-4c28-b05c-1ef6bd06991d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.333060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50f96-6bdb-4c28-b05c-1ef6bd06991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.351336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a8e50f96-6bdb-4c28-b05c-1ef6bd06991d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:20.353099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a8e50f96-6bdb-4c28-b05c-1ef6bd06991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:20.360850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 82/162] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:20.386728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abbb9-6118-4347-ae58-430a15040331 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.399646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abbb9-6118-4347-ae58-430a15040331 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.404080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.404861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.405142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.405416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.416528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:20.423494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:20.424696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 81/163] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:20.431097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50f96-6bdb-4c28-b05c-1ef6bd06991d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.440049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50f96-6bdb-4c28-b05c-1ef6bd06991d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.444661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.445312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.445643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.445924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.447243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:20.447550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.449175 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.457632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 83/164] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:20.463733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.473612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a574ee-1d9d-4c44-8069-86647aa8101f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.488464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.488464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.488464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.488464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] PATH_INFO: `/v3/users/006e3536282045bd8a55063307aeb44d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.504891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] RBAC: Authorizing `identity:get_user(user_id=006e3536282045bd8a55063307aeb44d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.507404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.509881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 82/165] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/users/006e3536282045bd8a55063307aeb44d => generated 283 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:20.518208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.527121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa3da8-143e-4c0c-9dd3-41d4ddfc3d4b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.532039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.532685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.532967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.533244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.544527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.546350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.556638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 84/166] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:20.562928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.572986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cea10-315a-4b4a-8ed6-ae34db61013e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.577572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f3a9f-678d-4292-be66-e0f82114d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.578409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3a9f-678d-4292-be66-e0f82114d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.578695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3a9f-678d-4292-be66-e0f82114d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.578975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3a9f-678d-4292-be66-e0f82114d5e2 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.580237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f3a9f-678d-4292-be66-e0f82114d5e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.582424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f3a9f-678d-4292-be66-e0f82114d5e2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.584240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 83/167] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:20.591634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.601311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313417-9258-4663-ad82-db3ceaade144 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.606432 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9dbfc-93ed-4b6f-a75c-82fb1eaf5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.607109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9dbfc-93ed-4b6f-a75c-82fb1eaf5dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.607388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9dbfc-93ed-4b6f-a75c-82fb1eaf5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.607663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9dbfc-93ed-4b6f-a75c-82fb1eaf5dfc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.608542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9dbfc-93ed-4b6f-a75c-82fb1eaf5dfc admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=2a0c29736da14389888d8615f26f6f27, user.id=006e3536282045bd8a55063307aeb44d) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:20.608856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9dbfc-93ed-4b6f-a75c-82fb1eaf5dfc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.610829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9dbfc-93ed-4b6f-a75c-82fb1eaf5dfc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.617608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 85/168] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/role_assignments?user.id=006e3536282045bd8a55063307aeb44d&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:20.746425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761435c0-c295-46a8-9390-fa8fdb299521 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.746789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761435c0-c295-46a8-9390-fa8fdb299521 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.746987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761435c0-c295-46a8-9390-fa8fdb299521 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.748803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 84/169] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:20.755507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2a92-cccd-4bca-b394-0e655c8a549b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.755779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2a92-cccd-4bca-b394-0e655c8a549b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.756061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2a92-cccd-4bca-b394-0e655c8a549b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.777246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-24fc2a92-cccd-4bca-b394-0e655c8a549b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:20.778524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-24fc2a92-cccd-4bca-b394-0e655c8a549b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:20.786711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 86/170] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:20.813445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761435c0-c295-46a8-9390-fa8fdb299521 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.826746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761435c0-c295-46a8-9390-fa8fdb299521 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.831977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.832709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.833041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.833315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.848236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:20.857364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:20.858888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 85/171] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:20.865789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc2a92-cccd-4bca-b394-0e655c8a549b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.875955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc2a92-cccd-4bca-b394-0e655c8a549b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.880456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.881120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.881406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.881682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.882521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:20.882828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.885148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.894610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 87/172] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:20.901066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.911398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6041-cb26-408b-abd3-bf4447ff6e8d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.916689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.917771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.918263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.918674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.920400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.922461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.930933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 86/173] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:20.932641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.943936 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356e68-fef9-41d0-8769-da34a6991646 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.949836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.950732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.951199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.951610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.960355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:20.962490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:20.976843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 88/174] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:20.979088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:20.989693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7386b1a-a5dd-453d-b9f9-9fc5b989e6eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:20.995029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609e758-986c-4a75-bd85-24f1e8fe30ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:20.996125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e758-986c-4a75-bd85-24f1e8fe30ad admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:20.996563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e758-986c-4a75-bd85-24f1e8fe30ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:20.997025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e758-986c-4a75-bd85-24f1e8fe30ad admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:20.998362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609e758-986c-4a75-bd85-24f1e8fe30ad admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.000643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609e758-986c-4a75-bd85-24f1e8fe30ad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.006271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 87/175] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:20 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:21.010131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.021326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d0be-4744-4b15-b582-d3e957bbf429 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.026829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedfda3-2bd8-4bfb-813c-f701dc8fcd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.027924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedfda3-2bd8-4bfb-813c-f701dc8fcd3c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.028393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedfda3-2bd8-4bfb-813c-f701dc8fcd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.028827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedfda3-2bd8-4bfb-813c-f701dc8fcd3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.029944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedfda3-2bd8-4bfb-813c-f701dc8fcd3c admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=2a0c29736da14389888d8615f26f6f27, user.id=6fe756dac77c46179eda340982f2b52b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:21.030446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedfda3-2bd8-4bfb-813c-f701dc8fcd3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.032569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedfda3-2bd8-4bfb-813c-f701dc8fcd3c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.039377 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 89/176] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/role_assignments?user.id=6fe756dac77c46179eda340982f2b52b&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:21.206581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d226-03be-4179-b9ab-a988d18ef263 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.207047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d226-03be-4179-b9ab-a988d18ef263 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.207415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d226-03be-4179-b9ab-a988d18ef263 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.209744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 88/177] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:21.216563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57777f7-02bd-4948-a12b-3ada85809929 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.217111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57777f7-02bd-4948-a12b-3ada85809929 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.217526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57777f7-02bd-4948-a12b-3ada85809929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.237494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d57777f7-02bd-4948-a12b-3ada85809929 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:21.239006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d57777f7-02bd-4948-a12b-3ada85809929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:21.251762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 90/178] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:21.279423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d226-03be-4179-b9ab-a988d18ef263 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.294332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d226-03be-4179-b9ab-a988d18ef263 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.298954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c71f-74b7-41f6-9b58-bedabfdc1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.300187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c71f-74b7-41f6-9b58-bedabfdc1022 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.300940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c71f-74b7-41f6-9b58-bedabfdc1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.301405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c71f-74b7-41f6-9b58-bedabfdc1022 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.302897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c71f-74b7-41f6-9b58-bedabfdc1022 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.305109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d1e4c-74a7-404f-9af8-50a6a4e5cbee None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.306361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d1e4c-74a7-404f-9af8-50a6a4e5cbee None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.306882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d1e4c-74a7-404f-9af8-50a6a4e5cbee None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.307873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3c71f-74b7-41f6-9b58-bedabfdc1022 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.309748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 91/179] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:21.310228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 89/180] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:21.316339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d1e4c-74a7-404f-9af8-50a6a4e5cbee None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.317714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3261e3-57af-479c-a5d2-f49a9e77116a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.318004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3261e3-57af-479c-a5d2-f49a9e77116a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.318314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3261e3-57af-479c-a5d2-f49a9e77116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.333101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d1e4c-74a7-404f-9af8-50a6a4e5cbee None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.338960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.339883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.340336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.340636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-db3261e3-57af-479c-a5d2-f49a9e77116a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:21.341204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.342092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.342750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-db3261e3-57af-479c-a5d2-f49a9e77116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:21.344464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.354334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 90/181] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:21.380856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3261e3-57af-479c-a5d2-f49a9e77116a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.390992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3261e3-57af-479c-a5d2-f49a9e77116a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.395900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.396720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.397005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.397282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.409384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:21.417461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:21.421231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 91/182] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:21.425080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.441833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 92/183] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:21 2021] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:14:21.442005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f3564-243a-4dcc-adc8-12094ddd104f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.448816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.449910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.450405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.450931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.451968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:21.452468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.454523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.468782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 92/184] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:21.474528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.485176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd78a6-a4b8-445a-8919-42091cd795b3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.489873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.490809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.491094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.491373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] PATH_INFO: `/v3/users/006e3536282045bd8a55063307aeb44d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.492673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] RBAC: Authorizing `identity:get_user(user_id=006e3536282045bd8a55063307aeb44d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.495541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.497673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 93/185] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/users/006e3536282045bd8a55063307aeb44d => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:21.503923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.514825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0901d5-b79e-4ec1-88c5-a5cf65a3671a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.519845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.520507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.520791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.521072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.530387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.532258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.544314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 93/186] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:21.551025 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.563033 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf643e1-aec9-4074-9aa0-0f3c881c6431 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.567768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c6824-b0db-4860-abc1-0eb821b033e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.568815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c6824-b0db-4860-abc1-0eb821b033e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.569266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c6824-b0db-4860-abc1-0eb821b033e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.569731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c6824-b0db-4860-abc1-0eb821b033e7 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.572344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c6824-b0db-4860-abc1-0eb821b033e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.574852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c6824-b0db-4860-abc1-0eb821b033e7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.577082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 94/187] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:21.583337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:21.593358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390785-4763-44de-81e8-3f389d92e992 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:21.598016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2023c6-5447-49ec-bbd8-5088c21b3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:21.598745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2023c6-5447-49ec-bbd8-5088c21b3c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:21.599036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2023c6-5447-49ec-bbd8-5088c21b3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:21.599317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2023c6-5447-49ec-bbd8-5088c21b3c37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:21.600198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2023c6-5447-49ec-bbd8-5088c21b3c37 admin admin] RBAC: Adding query filter params (role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=2a0c29736da14389888d8615f26f6f27, user.id=006e3536282045bd8a55063307aeb44d) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:21.600515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2023c6-5447-49ec-bbd8-5088c21b3c37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:21.603122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2023c6-5447-49ec-bbd8-5088c21b3c37 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:21.609607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 94/188] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:21 2021] GET /identity/v3/role_assignments?user.id=006e3536282045bd8a55063307aeb44d&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=019207b971e242a29fd501b9b5a887f8 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:23.462649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20646a88-7bb8-4c84-ad84-fcc7837d84c4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.463511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20646a88-7bb8-4c84-ad84-fcc7837d84c4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.463934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20646a88-7bb8-4c84-ad84-fcc7837d84c4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.466156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 95/189] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:23.480520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ce8d-419e-4b42-a31a-3037e90e612c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.481321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ce8d-419e-4b42-a31a-3037e90e612c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.481747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ce8d-419e-4b42-a31a-3037e90e612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.505479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6b81ce8d-419e-4b42-a31a-3037e90e612c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:23.506922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6b81ce8d-419e-4b42-a31a-3037e90e612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:23.518891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 95/190] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:23.560019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20646a88-7bb8-4c84-ad84-fcc7837d84c4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:23.576185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20646a88-7bb8-4c84-ad84-fcc7837d84c4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:23.580795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:23.581763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.582221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.582643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.597046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:23.604207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:23.605590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 96/191] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:23.611946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ce8d-419e-4b42-a31a-3037e90e612c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:23.622108 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ce8d-419e-4b42-a31a-3037e90e612c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:23.630635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:23.631580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.632121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.632543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.634102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:23.634614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:23.636414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:23.651519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 96/192] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:23.659300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:23.675507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e56f61-c359-4eb8-b26c-161b812538ec admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:23.683291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:23.684315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.684764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.685185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] PATH_INFO: `/v3/users/006e3536282045bd8a55063307aeb44d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.686614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=006e3536282045bd8a55063307aeb44d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:23.688907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:23.690697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 97/193] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:23 2021] GET /identity/v3/users/006e3536282045bd8a55063307aeb44d => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:23.697625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:23.707547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069cadc-1827-4e61-86a4-a7eb4fecc738 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:23.718319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416bdd7-1c3a-4806-93a6-5fc4ce712d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:23.719337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416bdd7-1c3a-4806-93a6-5fc4ce712d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.719763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416bdd7-1c3a-4806-93a6-5fc4ce712d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.720199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416bdd7-1c3a-4806-93a6-5fc4ce712d0a admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.721564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416bdd7-1c3a-4806-93a6-5fc4ce712d0a admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:23.723781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416bdd7-1c3a-4806-93a6-5fc4ce712d0a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:23.725598 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 97/194] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:23 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:23.732727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:23.747799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bf481-843b-46fe-b50d-8427198323e7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:23.758864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:23.759949 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.760375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.760816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27/users/006e3536282045bd8a55063307aeb44d/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.763146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0c29736da14389888d8615f26f6f27, user_id=006e3536282045bd8a55063307aeb44d, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:23.765928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:23.800694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cee01-5074-4453-a3df-f0482d70eb44 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.800983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cee01-5074-4453-a3df-f0482d70eb44 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.801264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cee01-5074-4453-a3df-f0482d70eb44 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.803173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 98/195] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:23.809462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641e56-6c72-4654-8b3f-84eb59d54551 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.809750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641e56-6c72-4654-8b3f-84eb59d54551 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.810026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f641e56-6c72-4654-8b3f-84eb59d54551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.828441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5f641e56-6c72-4654-8b3f-84eb59d54551 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:23.829739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5f641e56-6c72-4654-8b3f-84eb59d54551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:23.838348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 99/196] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:23.855640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 98/197] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:23 2021] PUT /identity/v3/projects/2a0c29736da14389888d8615f26f6f27/users/006e3536282045bd8a55063307aeb44d/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:23.879613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641e56-6c72-4654-8b3f-84eb59d54551 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:23.891629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f641e56-6c72-4654-8b3f-84eb59d54551 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:23.951757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:23.952608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:23.952896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:23.953171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:23.964429 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:23.974372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:23.976123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 100/198] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:23.983300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:23.998217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae1207-6046-458c-a1e6-a59ae935875c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.008553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.009236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.009566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.009846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.010716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:24.011021 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.012852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.027010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 99/199] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:24.034627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.050089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e511ff-8453-426c-a53b-48ceac1e6ae2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.063002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.063909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.064261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.064463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.065812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.067670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.069637 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 101/200] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:24.076398 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.092054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c6513-7c70-45d5-b967-346c739c987a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.104328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b70978-3062-45bb-b7f6-c13243b8a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.105210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b70978-3062-45bb-b7f6-c13243b8a7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.105588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b70978-3062-45bb-b7f6-c13243b8a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.105911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b70978-3062-45bb-b7f6-c13243b8a7cb admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.107811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b70978-3062-45bb-b7f6-c13243b8a7cb admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.110090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b70978-3062-45bb-b7f6-c13243b8a7cb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.112094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 100/201] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:24.119230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.136217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370d90-7df8-4e00-855b-68808935d17e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.151658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264154e-c03e-4e49-b89b-2f6eaf95e2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.152577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264154e-c03e-4e49-b89b-2f6eaf95e2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.152864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264154e-c03e-4e49-b89b-2f6eaf95e2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.153142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264154e-c03e-4e49-b89b-2f6eaf95e2b1 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27/users/6fe756dac77c46179eda340982f2b52b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.159906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264154e-c03e-4e49-b89b-2f6eaf95e2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0c29736da14389888d8615f26f6f27, user_id=6fe756dac77c46179eda340982f2b52b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.162702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264154e-c03e-4e49-b89b-2f6eaf95e2b1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.244449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 102/202] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:24 2021] PUT /identity/v3/projects/2a0c29736da14389888d8615f26f6f27/users/6fe756dac77c46179eda340982f2b52b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:24.268293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3a7ec-75ea-4129-9e6b-5dbf797ace04 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.268612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3a7ec-75ea-4129-9e6b-5dbf797ace04 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.268856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3a7ec-75ea-4129-9e6b-5dbf797ace04 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.270782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 101/203] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:24.278119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031360-edd6-4fee-b7ed-bff4c31f1335 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.278471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031360-edd6-4fee-b7ed-bff4c31f1335 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.278725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031360-edd6-4fee-b7ed-bff4c31f1335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.359835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eeb5d-ad11-4155-b1fa-f55451ba16a0 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.360161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eeb5d-ad11-4155-b1fa-f55451ba16a0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.360389 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eeb5d-ad11-4155-b1fa-f55451ba16a0 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.362338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 102/204] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:24.369457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb348c5-09bf-460e-8bb2-6580941c3030 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.369828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb348c5-09bf-460e-8bb2-6580941c3030 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.370858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb348c5-09bf-460e-8bb2-6580941c3030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.398674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-78031360-edd6-4fee-b7ed-bff4c31f1335 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:24.399972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-78031360-edd6-4fee-b7ed-bff4c31f1335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:24.408396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2bb348c5-09bf-460e-8bb2-6580941c3030 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:24.409701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2bb348c5-09bf-460e-8bb2-6580941c3030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:24.478479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 103/205] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:24.512758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 103/206] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:24.519368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb348c5-09bf-460e-8bb2-6580941c3030 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.529360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb348c5-09bf-460e-8bb2-6580941c3030 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.534306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.536254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.536254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.536254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.537626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.540614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.540808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031360-edd6-4fee-b7ed-bff4c31f1335 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.540976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 104/207] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:24.547818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.548860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031360-edd6-4fee-b7ed-bff4c31f1335 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.553428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.554325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.555528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.555875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.559767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ce3bf-3145-4001-8eee-39e05a5ffaba admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.564264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.564915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.565195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.565466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.566205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.567454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:24.568267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.575698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:24.577144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 104/208] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:24.583213 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.594196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d27be-cfda-4fda-9541-9efeac3943d2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.599129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abb006-9cc3-4c57-8d60-c1402cb35334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.599910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abb006-9cc3-4c57-8d60-c1402cb35334 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.600267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abb006-9cc3-4c57-8d60-c1402cb35334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.600611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abb006-9cc3-4c57-8d60-c1402cb35334 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.601566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abb006-9cc3-4c57-8d60-c1402cb35334 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:24.601943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abb006-9cc3-4c57-8d60-c1402cb35334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.603648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abb006-9cc3-4c57-8d60-c1402cb35334 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.612834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 105/209] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:24.613950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f818a2-9cb9-40eb-b9ca-3b835a177cdf None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.614285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f818a2-9cb9-40eb-b9ca-3b835a177cdf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.614568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f818a2-9cb9-40eb-b9ca-3b835a177cdf None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.616203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 106/210] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:24.621397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f818a2-9cb9-40eb-b9ca-3b835a177cdf None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.633695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f818a2-9cb9-40eb-b9ca-3b835a177cdf None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.637865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154603b-b7a3-4828-a087-6d957276a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.638734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154603b-b7a3-4828-a087-6d957276a409 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.639016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154603b-b7a3-4828-a087-6d957276a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.639288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154603b-b7a3-4828-a087-6d957276a409 admin admin] PATH_INFO: `/v3/users/006e3536282045bd8a55063307aeb44d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.640469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154603b-b7a3-4828-a087-6d957276a409 admin admin] RBAC: Authorizing `identity:get_user(user_id=006e3536282045bd8a55063307aeb44d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.642620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154603b-b7a3-4828-a087-6d957276a409 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.644446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 107/211] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/users/006e3536282045bd8a55063307aeb44d => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:24.645718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eaf09-7f9e-4f84-863a-7d42f5579be4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.646002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eaf09-7f9e-4f84-863a-7d42f5579be4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.650209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eaf09-7f9e-4f84-863a-7d42f5579be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.667073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-086eaf09-7f9e-4f84-863a-7d42f5579be4 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:24.668236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-086eaf09-7f9e-4f84-863a-7d42f5579be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:24.676088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 105/212] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:24 2021] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:24.677066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.680233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 108/213] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:24.688321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f82ef-a169-414a-a397-51a93e8529a6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.693154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.694265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.694664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.695624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.697224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.699576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.701802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 106/214] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:24.708010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086eaf09-7f9e-4f84-863a-7d42f5579be4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.708509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.720777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c53926-9d82-468d-94fe-80588ff740ae admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.725848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.727013 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.727300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.727578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27/users/006e3536282045bd8a55063307aeb44d/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.729022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086eaf09-7f9e-4f84-863a-7d42f5579be4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.730293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0c29736da14389888d8615f26f6f27, user_id=006e3536282045bd8a55063307aeb44d, role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.733181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.740894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.741856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.742209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.742518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.755644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:24.763894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:24.765212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 109/215] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:24.773160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.784627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68248e-c147-446d-82d7-d168ef9cf718 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.789672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.790480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.790780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.791164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.791969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:24.792287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.794145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.808861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 107/216] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:24 2021] PUT /identity/v3/projects/2a0c29736da14389888d8615f26f6f27/users/006e3536282045bd8a55063307aeb44d/roles/019207b971e242a29fd501b9b5a887f8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:24.816418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 110/217] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:24.824251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.911235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cd292-8b17-4a0d-932d-b1c5db4ceafc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.916932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9dd6-d446-40eb-bd25-3704444f25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.917839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9dd6-d446-40eb-bd25-3704444f25fd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.918126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9dd6-d446-40eb-bd25-3704444f25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.918491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9dd6-d446-40eb-bd25-3704444f25fd admin admin] PATH_INFO: `/v3/users/b27299f2b50e4fd4a5c0200ba30f5007` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.943473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d9dd6-d446-40eb-bd25-3704444f25fd admin admin] RBAC: Authorizing `identity:get_user(user_id=b27299f2b50e4fd4a5c0200ba30f5007)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.946563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d9dd6-d446-40eb-bd25-3704444f25fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.948392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 108/218] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/users/b27299f2b50e4fd4a5c0200ba30f5007 => generated 293 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:24.955031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:24.967910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951f27-20e2-472e-b4be-1b40dd509e0c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:24.972887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69fa7-1611-4a43-b229-bd8c1ae87adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:24.973616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69fa7-1611-4a43-b229-bd8c1ae87adf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:24.973954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69fa7-1611-4a43-b229-bd8c1ae87adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:24.974259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69fa7-1611-4a43-b229-bd8c1ae87adf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:24.975184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69fa7-1611-4a43-b229-bd8c1ae87adf admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, user.id=b27299f2b50e4fd4a5c0200ba30f5007, scope.system=all) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:24.975506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69fa7-1611-4a43-b229-bd8c1ae87adf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:24.978149 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69fa7-1611-4a43-b229-bd8c1ae87adf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:24.987423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 111/219] 10.222.0.11 () {56 vars in 1329 bytes} [Thu Nov 11 16:14:24 2021] GET /identity/v3/role_assignments?user.id=b27299f2b50e4fd4a5c0200ba30f5007&scope.system=all&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:26.775542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b516cc-14d2-4a01-8f90-2eb2bfe5e0af None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:26.776045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b516cc-14d2-4a01-8f90-2eb2bfe5e0af None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:26.776116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b516cc-14d2-4a01-8f90-2eb2bfe5e0af None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:26.778096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 109/220] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:26.784292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18712-2081-42c8-861e-b56c8c9f8a14 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:26.784691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18712-2081-42c8-861e-b56c8c9f8a14 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:26.784854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18712-2081-42c8-861e-b56c8c9f8a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:26.807312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0fa18712-2081-42c8-861e-b56c8c9f8a14 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:26.808430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0fa18712-2081-42c8-861e-b56c8c9f8a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:26.821828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 112/221] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:26.859362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b516cc-14d2-4a01-8f90-2eb2bfe5e0af None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:26.873516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b516cc-14d2-4a01-8f90-2eb2bfe5e0af None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:26.880598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:26.881387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:26.881674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:26.882536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:26.894660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:26.901870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:26.903102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 110/222] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:26.909470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa18712-2081-42c8-861e-b56c8c9f8a14 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:26.918650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa18712-2081-42c8-861e-b56c8c9f8a14 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:26.926267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:26.926939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:26.927226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:26.927503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:26.928280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:26.928589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:26.930875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:26.946642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 113/223] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:26.952445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:26.962394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8bc79-d060-460c-899f-8a2ebe6ba6e3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:26.970295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:26.971171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:26.971453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:26.971729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] PATH_INFO: `/v3/users/006e3536282045bd8a55063307aeb44d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:26.972966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] RBAC: Authorizing `identity:get_user(user_id=006e3536282045bd8a55063307aeb44d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:26.975149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:26.977621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 111/224] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:26 2021] GET /identity/v3/users/006e3536282045bd8a55063307aeb44d => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:26.983308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:26.993924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6557718-4d54-4727-898a-885cb38ef249 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:26.999378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.000029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.000314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.000589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.013802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.015611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.027696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 114/225] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:14:27.033792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.047717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde1c7-b7e9-44e7-871f-c07ff89ce401 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.056594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba8627-ba75-4629-b4f0-989fabc8d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.057495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8627-ba75-4629-b4f0-989fabc8d47a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.057719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8627-ba75-4629-b4f0-989fabc8d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.057992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8627-ba75-4629-b4f0-989fabc8d47a admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.059250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba8627-ba75-4629-b4f0-989fabc8d47a admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.061313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba8627-ba75-4629-b4f0-989fabc8d47a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.063228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 112/226] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:27.070499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.083181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f1d3a-0ef6-4fcc-a357-485972b9c4b9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.093022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85e58f-6118-404b-bc07-b39c81945335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.093715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e58f-6118-404b-bc07-b39c81945335 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.093995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e58f-6118-404b-bc07-b39c81945335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.094305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85e58f-6118-404b-bc07-b39c81945335 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.095202 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e58f-6118-404b-bc07-b39c81945335 admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=2a0c29736da14389888d8615f26f6f27, user.id=006e3536282045bd8a55063307aeb44d) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:27.095521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e58f-6118-404b-bc07-b39c81945335 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.097450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85e58f-6118-404b-bc07-b39c81945335 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.107133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 115/227] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/role_assignments?user.id=006e3536282045bd8a55063307aeb44d&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:27.434055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafa21c-e312-49c1-a6aa-cc728b4a6a28 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.434461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafa21c-e312-49c1-a6aa-cc728b4a6a28 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.434762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafa21c-e312-49c1-a6aa-cc728b4a6a28 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.436774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 113/228] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:27.449671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce6d3-573e-4c0e-8ac7-106837f30f65 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.449980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce6d3-573e-4c0e-8ac7-106837f30f65 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.450248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce6d3-573e-4c0e-8ac7-106837f30f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.479209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-934ce6d3-573e-4c0e-8ac7-106837f30f65 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:27.480837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-934ce6d3-573e-4c0e-8ac7-106837f30f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:27.491635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 116/229] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:27.541773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafa21c-e312-49c1-a6aa-cc728b4a6a28 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.561458 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafa21c-e312-49c1-a6aa-cc728b4a6a28 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.565980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.566785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.567069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.567341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.587186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:27.594040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:27.595618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 114/230] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:27.601911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ce6d3-573e-4c0e-8ac7-106837f30f65 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.614988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ce6d3-573e-4c0e-8ac7-106837f30f65 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.626321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.627274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.627749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.628236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.629203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:27.629789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.631597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.645980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 117/231] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:27.654810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.667251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da569f-06f0-40c9-b396-db662b3ce991 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.674253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.675126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.675408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.675686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.682942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.684819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.686431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 115/232] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:27.692419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.706222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768af3-f653-433c-9c6f-e5c40f865ecc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.714609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.715674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.716152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.716622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.734103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.736271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.752270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 118/233] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:27.758674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.771872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e541-c815-4667-b08e-f330ba51fb4b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.779354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835545cf-2b71-4d67-a98b-1be5d0997d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.780207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835545cf-2b71-4d67-a98b-1be5d0997d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.780487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835545cf-2b71-4d67-a98b-1be5d0997d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.780757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835545cf-2b71-4d67-a98b-1be5d0997d31 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.781976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835545cf-2b71-4d67-a98b-1be5d0997d31 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.784081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835545cf-2b71-4d67-a98b-1be5d0997d31 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.785762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 116/234] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:27.792969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:27.802099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef0c6-b478-4089-80e9-512f4e108b40 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:27.810264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266ac84-0d51-43a5-b74a-f81ada15488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:27.810915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266ac84-0d51-43a5-b74a-f81ada15488e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.811201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266ac84-0d51-43a5-b74a-f81ada15488e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.811480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266ac84-0d51-43a5-b74a-f81ada15488e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.812329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266ac84-0d51-43a5-b74a-f81ada15488e admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=2a0c29736da14389888d8615f26f6f27, user.id=6fe756dac77c46179eda340982f2b52b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:27.812642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266ac84-0d51-43a5-b74a-f81ada15488e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:27.814511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266ac84-0d51-43a5-b74a-f81ada15488e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:27.826949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 119/235] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:27 2021] GET /identity/v3/role_assignments?user.id=6fe756dac77c46179eda340982f2b52b&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:27.922967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c0e45-853b-4309-86af-185a824a47ce None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.923330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c0e45-853b-4309-86af-185a824a47ce None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.923530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c0e45-853b-4309-86af-185a824a47ce None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.925587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 117/236] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:27.931988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fea2-cd37-4e5b-94d4-16f32d58873c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:27.932287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fea2-cd37-4e5b-94d4-16f32d58873c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:27.932565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fea2-cd37-4e5b-94d4-16f32d58873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:27.955768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4b45fea2-cd37-4e5b-94d4-16f32d58873c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:27.956880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4b45fea2-cd37-4e5b-94d4-16f32d58873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:27.969811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 120/237] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:28.011911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c0e45-853b-4309-86af-185a824a47ce None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.028633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c0e45-853b-4309-86af-185a824a47ce None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.036210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.037002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.037283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.037554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.052652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:28.060144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:28.061354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 118/238] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:28.067666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45fea2-cd37-4e5b-94d4-16f32d58873c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.083649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45fea2-cd37-4e5b-94d4-16f32d58873c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.092612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.093292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.093576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.093853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.094669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:28.094978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.096581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.110166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 121/239] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:28.117492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.131472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30cc05-c2b8-4968-b734-aaa312640209 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.139809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cce30d-085d-4236-b2d2-fc15db666726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.140677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cce30d-085d-4236-b2d2-fc15db666726 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.140954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cce30d-085d-4236-b2d2-fc15db666726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.141227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cce30d-085d-4236-b2d2-fc15db666726 admin admin] PATH_INFO: `/v3/users/b27299f2b50e4fd4a5c0200ba30f5007` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.142747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cce30d-085d-4236-b2d2-fc15db666726 admin admin] RBAC: Authorizing `identity:get_user(user_id=b27299f2b50e4fd4a5c0200ba30f5007)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.144884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cce30d-085d-4236-b2d2-fc15db666726 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.146815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 119/240] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/users/b27299f2b50e4fd4a5c0200ba30f5007 => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:28.153781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.159802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6660-7684-4597-b3db-e6dc6916ffbd None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.160096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6660-7684-4597-b3db-e6dc6916ffbd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.160360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6660-7684-4597-b3db-e6dc6916ffbd None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.162561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 120/241] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:28 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:28.170011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ab74f-a0ec-431f-bef5-bd97a0a56ebc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.170303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b0e77-186a-4308-a1aa-874995100d6f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.170475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ab74f-a0ec-431f-bef5-bd97a0a56ebc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.170980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ab74f-a0ec-431f-bef5-bd97a0a56ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.181171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.183099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.184877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.185175 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] PATH_INFO: `/v3/system/users/b27299f2b50e4fd4a5c0200ba30f5007/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.189395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b27299f2b50e4fd4a5c0200ba30f5007, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.190528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:28.190528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:28.190528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:28.191457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.202446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ae2ab74f-a0ec-431f-bef5-bd97a0a56ebc None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:28.203675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ae2ab74f-a0ec-431f-bef5-bd97a0a56ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:28.214240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 121/242] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:28.238954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ab74f-a0ec-431f-bef5-bd97a0a56ebc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.249664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ab74f-a0ec-431f-bef5-bd97a0a56ebc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.254458 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.255263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.255550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.255829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.268661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:28.276709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:28.283038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 122/243] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:28.284144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.294406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 122/244] 10.222.0.11 () {58 vars in 1355 bytes} [Thu Nov 11 16:14:28 2021] PUT /identity/v3/system/users/b27299f2b50e4fd4a5c0200ba30f5007/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:14:28.296380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e43a3-971e-46e0-bd03-81723b36118e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.301372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.302193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.302496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.312001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.312001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:28.312001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.312001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.317457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 123/245] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:28.325045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.337222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40324a-2f76-49de-bd76-f78d504797b3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.342214 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.343163 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.343451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.343731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] PATH_INFO: `/v3/users/006e3536282045bd8a55063307aeb44d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.345106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=006e3536282045bd8a55063307aeb44d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.347520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.349339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 123/246] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/users/006e3536282045bd8a55063307aeb44d => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:28.356196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.368086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0e7e-793f-4bce-be1a-b19e196241c6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.373187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.373899 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.374267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.374583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.384617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.386690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.398710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 124/247] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:28.405097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.416012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00efe9e-ca17-4431-bc97-963f768bc9f8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.420861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b44881-4153-4378-9cfb-0b35c29eff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.421809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44881-4153-4378-9cfb-0b35c29eff9b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.422101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44881-4153-4378-9cfb-0b35c29eff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.422403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b44881-4153-4378-9cfb-0b35c29eff9b admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.423895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b44881-4153-4378-9cfb-0b35c29eff9b admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.426285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b44881-4153-4378-9cfb-0b35c29eff9b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.429143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 124/248] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:28.435982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.447015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e8aa7-b794-4e08-bdc2-aacdac07190a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.452056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e330c60-0427-4944-84fd-5d8c2580fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.452742 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330c60-0427-4944-84fd-5d8c2580fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.453028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330c60-0427-4944-84fd-5d8c2580fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.453305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330c60-0427-4944-84fd-5d8c2580fe61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.454357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e330c60-0427-4944-84fd-5d8c2580fe61 admin admin] RBAC: Adding query filter params (role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=2a0c29736da14389888d8615f26f6f27, user.id=006e3536282045bd8a55063307aeb44d) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:28.454682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e330c60-0427-4944-84fd-5d8c2580fe61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.456698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e330c60-0427-4944-84fd-5d8c2580fe61 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.464491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 125/249] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/role_assignments?user.id=006e3536282045bd8a55063307aeb44d&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=019207b971e242a29fd501b9b5a887f8 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:28.595496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcdf0b-1a02-49d8-9753-543fb3f4916b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.595828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcdf0b-1a02-49d8-9753-543fb3f4916b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.596047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcdf0b-1a02-49d8-9753-543fb3f4916b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.597854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 125/250] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:28.605311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea271-5966-4731-9e45-002187312e78 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.605605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea271-5966-4731-9e45-002187312e78 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.605891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea271-5966-4731-9e45-002187312e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.625979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-de6ea271-5966-4731-9e45-002187312e78 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:28.627253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-de6ea271-5966-4731-9e45-002187312e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:28.636822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 126/251] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:28.664596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcdf0b-1a02-49d8-9753-543fb3f4916b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.677920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcdf0b-1a02-49d8-9753-543fb3f4916b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.683218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.684039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.684322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.684610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.699470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:28.706533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 11 16:14:28.708098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 126/252] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:28.715437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ea271-5966-4731-9e45-002187312e78 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.725875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ea271-5966-4731-9e45-002187312e78 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.732133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339e42-5346-4997-a265-4c45339890b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.732802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339e42-5346-4997-a265-4c45339890b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.733080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339e42-5346-4997-a265-4c45339890b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.733350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339e42-5346-4997-a265-4c45339890b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.734110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339e42-5346-4997-a265-4c45339890b7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:28.734541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339e42-5346-4997-a265-4c45339890b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.736127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339e42-5346-4997-a265-4c45339890b7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.747281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 127/253] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:28.753326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.768092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e59b-0029-4180-ae18-3aa464863c9e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.772911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.773658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.773939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.774288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] PATH_INFO: `/v3/users/f1563e088f1a472f9aca3945c2bf6747` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.829091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568626f-72dd-4544-872e-b17d8cbed851 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.829637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568626f-72dd-4544-872e-b17d8cbed851 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.829637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568626f-72dd-4544-872e-b17d8cbed851 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.831693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 128/254] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:28.838638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c2ad-41d3-4d54-9215-6cd88f73af7e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.838929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c2ad-41d3-4d54-9215-6cd88f73af7e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.839208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c2ad-41d3-4d54-9215-6cd88f73af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.900820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1563e088f1a472f9aca3945c2bf6747)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.903048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.908556 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 127/255] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/users/f1563e088f1a472f9aca3945c2bf6747 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:28.911837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:28.921946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46afa1a-5b88-4457-aec4-a27047c80d89 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:28.926320 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:28.926988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:28.927330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:28.927605 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:28.929173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] RBAC: Adding query filter params (role.id=f4a161841b3c441589d1a6a4f1104889, user.id=f1563e088f1a472f9aca3945c2bf6747, scope.system=all) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:28.929483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:28.931429 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:28.942213 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 128/256] 10.222.0.11 () {56 vars in 1329 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/role_assignments?user.id=f1563e088f1a472f9aca3945c2bf6747&scope.system=all&role.id=f4a161841b3c441589d1a6a4f1104889 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:28.966444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d908c2ad-41d3-4d54-9215-6cd88f73af7e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:28.967590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d908c2ad-41d3-4d54-9215-6cd88f73af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:28.978215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 129/257] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:29.000071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:29.010048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47da7-acdf-4680-adbc-46c800204656 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:29.014550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f9fad-a9e6-4ae0-81ae-b6d85917893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:29.015354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9fad-a9e6-4ae0-81ae-b6d85917893c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:29.015633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9fad-a9e6-4ae0-81ae-b6d85917893c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:29.015904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f9fad-a9e6-4ae0-81ae-b6d85917893c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:29.017376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9fad-a9e6-4ae0-81ae-b6d85917893c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:29.019118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f9fad-a9e6-4ae0-81ae-b6d85917893c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:29.020939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 129/258] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:29.029268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c2ad-41d3-4d54-9215-6cd88f73af7e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:29.038813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c2ad-41d3-4d54-9215-6cd88f73af7e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:29.043272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f513fc3-92de-43c9-ab81-907c699415a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:29.043952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f513fc3-92de-43c9-ab81-907c699415a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:29.044238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f513fc3-92de-43c9-ab81-907c699415a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:29.044515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f513fc3-92de-43c9-ab81-907c699415a3 admin admin] PATH_INFO: `/v3/groups` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:29.045250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f513fc3-92de-43c9-ab81-907c699415a3 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:29.046321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-0f513fc3-92de-43c9-ab81-907c699415a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:29.046321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:29.046321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:29.047545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f513fc3-92de-43c9-ab81-907c699415a3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:29.132136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 130/259] 10.222.0.11 () {60 vars in 1155 bytes} [Thu Nov 11 16:14:29 2021] POST /identity/v3/groups => generated 229 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:30.643622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af82ed-26fb-4943-b091-e03fbb45529c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:30.644196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af82ed-26fb-4943-b091-e03fbb45529c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:30.644196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af82ed-26fb-4943-b091-e03fbb45529c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:30.646077 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 130/260] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:30.652361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fba5b-31a7-41d7-970d-fedadc1ac468 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:30.652732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fba5b-31a7-41d7-970d-fedadc1ac468 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:30.652969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fba5b-31a7-41d7-970d-fedadc1ac468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:30.670792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bf6fba5b-31a7-41d7-970d-fedadc1ac468 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:30.671969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bf6fba5b-31a7-41d7-970d-fedadc1ac468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:30.679624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 131/261] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:30.705261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af82ed-26fb-4943-b091-e03fbb45529c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:30.717984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af82ed-26fb-4943-b091-e03fbb45529c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:30.722158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:30.722969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:30.723253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:30.723537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:30.733770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:30.740739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:30.742137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 131/262] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:30.748196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fba5b-31a7-41d7-970d-fedadc1ac468 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:30.757975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fba5b-31a7-41d7-970d-fedadc1ac468 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:30.762265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:30.762915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:30.763196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:30.763471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:30.764244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:30.764551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:30.766162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:30.775256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 132/263] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:30.780946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:30.791672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee269d5-0e15-4581-8a37-53b7ebdda161 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:30.795889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d13bb5-926f-4dae-aae5-2bc21507c44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:30.796738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13bb5-926f-4dae-aae5-2bc21507c44d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:30.797022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13bb5-926f-4dae-aae5-2bc21507c44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:30.797299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13bb5-926f-4dae-aae5-2bc21507c44d admin admin] PATH_INFO: `/v3/users/b27299f2b50e4fd4a5c0200ba30f5007` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:30.798547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d13bb5-926f-4dae-aae5-2bc21507c44d admin admin] RBAC: Authorizing `identity:get_user(user_id=b27299f2b50e4fd4a5c0200ba30f5007)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:30.800682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d13bb5-926f-4dae-aae5-2bc21507c44d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:30.806227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 132/264] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:30 2021] GET /identity/v3/users/b27299f2b50e4fd4a5c0200ba30f5007 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:30.808716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:30.819175 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401ce39-5401-4ccd-b3e1-8306c3ec6dea admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:30.823374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a228440-e784-4975-be6b-e44ee8554e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:30.824012 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228440-e784-4975-be6b-e44ee8554e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:30.824289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228440-e784-4975-be6b-e44ee8554e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:30.824562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228440-e784-4975-be6b-e44ee8554e6a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:30.825406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228440-e784-4975-be6b-e44ee8554e6a admin admin] RBAC: Adding query filter params (role.id=f2eb341fe747486eb32039f7dcda8bc2, user.id=b27299f2b50e4fd4a5c0200ba30f5007, scope.system=all) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:30.825711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228440-e784-4975-be6b-e44ee8554e6a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:30.827673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228440-e784-4975-be6b-e44ee8554e6a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:30.845660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 133/265] 10.222.0.11 () {56 vars in 1329 bytes} [Thu Nov 11 16:14:30 2021] GET /identity/v3/role_assignments?user.id=b27299f2b50e4fd4a5c0200ba30f5007&scope.system=all&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:31.202282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9078-68ae-497c-a115-e52803b4170b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.202581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9078-68ae-497c-a115-e52803b4170b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.202864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9078-68ae-497c-a115-e52803b4170b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.204643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 133/266] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:31.211132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0833b-b5a5-4720-9c72-5f268d9abca3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.211421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0833b-b5a5-4720-9c72-5f268d9abca3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.211698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0833b-b5a5-4720-9c72-5f268d9abca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.229304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-77c0833b-b5a5-4720-9c72-5f268d9abca3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:31.230490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-77c0833b-b5a5-4720-9c72-5f268d9abca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:31.237712 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 134/267] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:31.260467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c9078-68ae-497c-a115-e52803b4170b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:31.273319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c9078-68ae-497c-a115-e52803b4170b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:31.277480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:31.278293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.278575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.280470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.289768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:31.296912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 11 16:14:31.298222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 134/268] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:31 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:31.305528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0833b-b5a5-4720-9c72-5f268d9abca3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:31.315030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0833b-b5a5-4720-9c72-5f268d9abca3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:31.320295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:31.320988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.321271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.321547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.322376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:31.322685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:31.324338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:31.333202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 135/269] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:31 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:31.341430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:31.352274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655db31-1eef-4ffd-a9ed-3e7200fa43f8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:31.356537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889ba1-1670-4c76-897d-8b467a6c17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:31.357378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889ba1-1670-4c76-897d-8b467a6c17a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.357663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889ba1-1670-4c76-897d-8b467a6c17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.357938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889ba1-1670-4c76-897d-8b467a6c17a0 admin admin] PATH_INFO: `/v3/users/f1563e088f1a472f9aca3945c2bf6747` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.359173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10889ba1-1670-4c76-897d-8b467a6c17a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1563e088f1a472f9aca3945c2bf6747)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:31.361293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10889ba1-1670-4c76-897d-8b467a6c17a0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:31.362895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 135/270] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:31 2021] GET /identity/v3/users/f1563e088f1a472f9aca3945c2bf6747 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:31.369192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:31.378799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721aeb-2674-4ac2-bc5d-19a30f97ae60 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:31.383055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:31.383893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.384175 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.384446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] PATH_INFO: `/v3/system/users/f1563e088f1a472f9aca3945c2bf6747/roles/f4a161841b3c441589d1a6a4f1104889` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.385922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f1563e088f1a472f9aca3945c2bf6747, role_id=f4a161841b3c441589d1a6a4f1104889)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:31.386985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:31.386985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:31.386985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:31.387840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:31.448855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67c61-6b1a-40e7-9973-00de71b3feef None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.449145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67c61-6b1a-40e7-9973-00de71b3feef None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.449424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67c61-6b1a-40e7-9973-00de71b3feef None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.451228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 136/271] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:31.453699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 136/272] 10.222.0.11 () {58 vars in 1355 bytes} [Thu Nov 11 16:14:31 2021] PUT /identity/v3/system/users/f1563e088f1a472f9aca3945c2bf6747/roles/f4a161841b3c441589d1a6a4f1104889 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:14:31.456737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffc9ce-7684-485b-86f0-4471491ef1fd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.457014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffc9ce-7684-485b-86f0-4471491ef1fd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.459834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffc9ce-7684-485b-86f0-4471491ef1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.476703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bfffc9ce-7684-485b-86f0-4471491ef1fd None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:31.477941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bfffc9ce-7684-485b-86f0-4471491ef1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:31.485738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 137/273] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:31.511208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:31.522738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80267e-889b-4b31-96f1-d1fce5c3052f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:31.527296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00ad5e-c148-4072-b69c-83dc8a624dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:31.528102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00ad5e-c148-4072-b69c-83dc8a624dab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.528389 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00ad5e-c148-4072-b69c-83dc8a624dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.528668 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00ad5e-c148-4072-b69c-83dc8a624dab admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.529889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00ad5e-c148-4072-b69c-83dc8a624dab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:31.531670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00ad5e-c148-4072-b69c-83dc8a624dab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:31.533354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 137/274] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:31.541871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffc9ce-7684-485b-86f0-4471491ef1fd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:31.551064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffc9ce-7684-485b-86f0-4471491ef1fd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:31.556529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c615c-e340-4b89-86bc-244f8ea3ac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:31.557209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c615c-e340-4b89-86bc-244f8ea3ac7a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:31.557495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c615c-e340-4b89-86bc-244f8ea3ac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:31.557775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c615c-e340-4b89-86bc-244f8ea3ac7a admin admin] PATH_INFO: `/v3/groups` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:31.558554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c615c-e340-4b89-86bc-244f8ea3ac7a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:31.559583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-c26c615c-e340-4b89-86bc-244f8ea3ac7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:31.559583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:31.559583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:31.560782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c615c-e340-4b89-86bc-244f8ea3ac7a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:31.645467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 138/275] 10.222.0.11 () {60 vars in 1155 bytes} [Thu Nov 11 16:14:31 2021] POST /identity/v3/groups => generated 226 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:33.996223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb29f-ff0e-46f3-be0d-8181cc8345d4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:33.996786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb29f-ff0e-46f3-be0d-8181cc8345d4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:33.996870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afb29f-ff0e-46f3-be0d-8181cc8345d4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:33.998923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 138/276] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:34.006463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e23c-f0d0-44fd-bf75-afe9ea209d26 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.006933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e23c-f0d0-44fd-bf75-afe9ea209d26 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.007015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e23c-f0d0-44fd-bf75-afe9ea209d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.032214 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4410e23c-f0d0-44fd-bf75-afe9ea209d26 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:34.033396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4410e23c-f0d0-44fd-bf75-afe9ea209d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:34.045625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 139/277] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:34.095702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb29f-ff0e-46f3-be0d-8181cc8345d4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.112023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afb29f-ff0e-46f3-be0d-8181cc8345d4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.116682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887b056-f295-459f-a667-32434a74087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.117456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887b056-f295-459f-a667-32434a74087c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.117737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887b056-f295-459f-a667-32434a74087c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.118009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887b056-f295-459f-a667-32434a74087c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.139152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887b056-f295-459f-a667-32434a74087c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:34.146830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-0887b056-f295-459f-a667-32434a74087c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 11 16:14:34.148258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 139/278] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/roles/reader => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:34.154858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e23c-f0d0-44fd-bf75-afe9ea209d26 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.164567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e23c-f0d0-44fd-bf75-afe9ea209d26 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.174326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.174996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.175276 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.175549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.176322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:34.176624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.178638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.194318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 140/279] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:34.200450 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887b056-f295-459f-a667-32434a74087c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.215154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887b056-f295-459f-a667-32434a74087c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.219801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b54c8-f2b2-4640-828c-c39f0ae2c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.220651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b54c8-f2b2-4640-828c-c39f0ae2c7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.220927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b54c8-f2b2-4640-828c-c39f0ae2c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.221200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b54c8-f2b2-4640-828c-c39f0ae2c7b6 admin admin] PATH_INFO: `/v3/users/f1563e088f1a472f9aca3945c2bf6747` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.226976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b54c8-f2b2-4640-828c-c39f0ae2c7b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=f1563e088f1a472f9aca3945c2bf6747)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.229166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b54c8-f2b2-4640-828c-c39f0ae2c7b6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.231129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 140/280] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/users/f1563e088f1a472f9aca3945c2bf6747 => generated 293 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:34.237451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.254195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7927-05cd-496f-8412-9234c0749fe4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.259379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dc1c5-f69c-4448-a9e3-86bd917a38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.260054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc1c5-f69c-4448-a9e3-86bd917a38f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.260335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc1c5-f69c-4448-a9e3-86bd917a38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.260608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc1c5-f69c-4448-a9e3-86bd917a38f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.261473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dc1c5-f69c-4448-a9e3-86bd917a38f9 admin admin] RBAC: Adding query filter params (role.id=f4a161841b3c441589d1a6a4f1104889, user.id=f1563e088f1a472f9aca3945c2bf6747, scope.system=all) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:34.261782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dc1c5-f69c-4448-a9e3-86bd917a38f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.263713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dc1c5-f69c-4448-a9e3-86bd917a38f9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.286195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 141/281] 10.222.0.11 () {56 vars in 1329 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/role_assignments?user.id=f1563e088f1a472f9aca3945c2bf6747&scope.system=all&role.id=f4a161841b3c441589d1a6a4f1104889 => generated 510 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:34.433365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29839-37eb-457b-b5be-4c4f53224ac9 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.433754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29839-37eb-457b-b5be-4c4f53224ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.433930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29839-37eb-457b-b5be-4c4f53224ac9 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.435696 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 141/282] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:34.443193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43621d80-2699-46c5-bf59-401d61bbbaee None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.444170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43621d80-2699-46c5-bf59-401d61bbbaee None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.444170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43621d80-2699-46c5-bf59-401d61bbbaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.467911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-43621d80-2699-46c5-bf59-401d61bbbaee None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:34.469104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-43621d80-2699-46c5-bf59-401d61bbbaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:34.481157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 142/283] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:34.526359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac29839-37eb-457b-b5be-4c4f53224ac9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.543313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac29839-37eb-457b-b5be-4c4f53224ac9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.558919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.559720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.559998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.560268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.578970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:34.586517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:34.588124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 142/284] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:34.594663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43621d80-2699-46c5-bf59-401d61bbbaee None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.604510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43621d80-2699-46c5-bf59-401d61bbbaee None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.609856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.610604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.610880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.611152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.611945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:34.612250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.613926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.628482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 143/285] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:34.635871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.651626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77194bb2-baea-4fef-ba18-52fbe3850b86 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.658922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.659589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.659871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.660144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.669449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.671322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.684904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 143/286] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:34.691430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.703289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637ea8-645b-4e5f-978a-74d223730c40 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.707818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.708947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.708947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.709310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.712099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.714155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.715862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 144/287] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:34.722902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.733098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50a33-45ca-4400-88ad-bf014b0b4e21 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.741245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0510e-8877-4699-a1c4-0a5584cad187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.742093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0510e-8877-4699-a1c4-0a5584cad187 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.742487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0510e-8877-4699-a1c4-0a5584cad187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.742729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0510e-8877-4699-a1c4-0a5584cad187 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.754840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0510e-8877-4699-a1c4-0a5584cad187 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.756413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-bcf0510e-8877-4699-a1c4-0a5584cad187 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:34.756413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:34.756413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:34.757600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0510e-8877-4699-a1c4-0a5584cad187 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.759725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 144/288] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:34.766821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:34.783541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbcc9-3092-4658-a57c-2f86143867bd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:34.789309 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37eca1-6aad-4498-9d3e-7f467b62a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:34.789962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37eca1-6aad-4498-9d3e-7f467b62a761 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:34.790280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37eca1-6aad-4498-9d3e-7f467b62a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:34.790558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37eca1-6aad-4498-9d3e-7f467b62a761 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:34.791411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37eca1-6aad-4498-9d3e-7f467b62a761 admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=549aab745e5b401181e0ecf7c85c05fe) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:34.791722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37eca1-6aad-4498-9d3e-7f467b62a761 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:34.793570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37eca1-6aad-4498-9d3e-7f467b62a761 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:34.800303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 145/289] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:34 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.309001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fc48-c610-4234-b453-04c1b0606c1a None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.309001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fc48-c610-4234-b453-04c1b0606c1a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.309001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fc48-c610-4234-b453-04c1b0606c1a None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.309001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 145/290] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:35.320275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa54ddd-be16-4d8c-8355-63831035dee1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.320275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa54ddd-be16-4d8c-8355-63831035dee1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.320275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa54ddd-be16-4d8c-8355-63831035dee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.322213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120addc-538c-4115-a7f0-0eb27fe245de None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.322429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120addc-538c-4115-a7f0-0eb27fe245de None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.322588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120addc-538c-4115-a7f0-0eb27fe245de None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.324840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 146/291] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:35.331445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21bee-0981-4dd7-b910-fc03acfcd1af None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.331764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21bee-0981-4dd7-b910-fc03acfcd1af None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.332015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21bee-0981-4dd7-b910-fc03acfcd1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.347981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2aa54ddd-be16-4d8c-8355-63831035dee1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:35.350772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2aa54ddd-be16-4d8c-8355-63831035dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:35.359501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-84c21bee-0981-4dd7-b910-fc03acfcd1af None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:35.360677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-84c21bee-0981-4dd7-b910-fc03acfcd1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:35.363864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 146/292] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:35.369691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 147/293] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:35.396754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa54ddd-be16-4d8c-8355-63831035dee1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.403598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21bee-0981-4dd7-b910-fc03acfcd1af None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.409874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa54ddd-be16-4d8c-8355-63831035dee1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.414544 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21bee-0981-4dd7-b910-fc03acfcd1af None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.415524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.416337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.416620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.416937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.420299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.421314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.421814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.422322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.430646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:35.434885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:35.440924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:35.442871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:35.449189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 147/294] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:35.449189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.449922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 148/295] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:35.452417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.461919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73108eb-fcff-45c8-a70e-eb6217aa717b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.464756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe475-57b5-4681-b46f-8bc7783c0c09 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.467780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.468445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.468730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.469007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.469921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:35.470251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.471394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.471992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.472506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.473009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.473481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.475213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:35.477027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.478916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.485361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 148/296] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.489185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.497654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 149/297] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.500499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d696adc-70a2-4a91-a0db-0b82a2fe8448 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.504867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.505105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.505812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.506102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.506415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.518201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.518465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.520754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904ffc8-908b-4c98-b210-0bcdc7883193 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.525499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.526429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.526931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.527407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.531454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 149/298] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:14:35.534857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.549054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322adf2-234e-4974-875f-dfa19edb86f4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.555121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.557282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.560209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.561012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.561294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.561574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.563932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.566888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.568705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 150/299] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.569726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 150/300] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:14:35.575492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.577521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.594930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a822015-3336-4c11-a12b-21e1d41ac50c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.597140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a1e35-7393-47c3-9df1-613e7f52f818 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.603151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343d8cc-4a4a-4380-b548-50a084ef44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.604267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343d8cc-4a4a-4380-b548-50a084ef44fd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.604821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343d8cc-4a4a-4380-b548-50a084ef44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.605386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343d8cc-4a4a-4380-b548-50a084ef44fd admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.606244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.607081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.607340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343d8cc-4a4a-4380-b548-50a084ef44fd admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.607450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.607687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.608977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.610076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:35.610076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:35.610076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:35.610515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343d8cc-4a4a-4380-b548-50a084ef44fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.611505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.612900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 151/301] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:35.613178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 151/302] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.615096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad5c1-f272-4898-8ee7-af7dfd49cd11 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.615597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad5c1-f272-4898-8ee7-af7dfd49cd11 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.616082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad5c1-f272-4898-8ee7-af7dfd49cd11 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.617949 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 152/303] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:35.622282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.625018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2ab2-7c35-4857-bfc4-3da2734aa8b5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.625415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2ab2-7c35-4857-bfc4-3da2734aa8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.625702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2ab2-7c35-4857-bfc4-3da2734aa8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.636152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad6344-0038-4c90-aa59-b9afd33ed3ce admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.641008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.641653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.642511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.642893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.643924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=549aab745e5b401181e0ecf7c85c05fe) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:35.644242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.646812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.651439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-600a2ab2-7c35-4857-bfc4-3da2734aa8b5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:35.652722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-600a2ab2-7c35-4857-bfc4-3da2734aa8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:35.652838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 152/304] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=019207b971e242a29fd501b9b5a887f8 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:35.653592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.678576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 153/305] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:35.680828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbbf59-a987-4e5b-beed-c052c385b766 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.686976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.687859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.688152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.688432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.690528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.692687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.694427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 153/306] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.701132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a2ab2-7c35-4857-bfc4-3da2734aa8b5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.712747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a2ab2-7c35-4857-bfc4-3da2734aa8b5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.724234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.725234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.725701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.726127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.727201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=2a0c29736da14389888d8615f26f6f27) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:35.727673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.729761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.736300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.748336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 154/307] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=019207b971e242a29fd501b9b5a887f8 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.750812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949efb1f-1666-4240-9e30-ae7a588b84c0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.761505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.762614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.763071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.763498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.781111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:35.788851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:35.790339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 154/308] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:35.797422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.811807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6aeaf-3b6b-49e3-8fa6-45aa8d045aff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.820069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.821031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.821463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.821901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.822864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:35.823318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.825089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.839397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 155/309] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.846171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.863745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c4091-477d-46bd-a94e-0726a42947ad admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.872067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.872987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.873417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.873873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.886325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.888391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.904574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 155/310] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:35.910838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.928310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744007e-7573-47a7-acaf-984292e8f1b7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.933367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.934249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.934539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.934815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.937531 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.939715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.941876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 156/311] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.948163 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.957501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d98a-aef2-40c9-9e34-f4e3846a597a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.963618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d58d0d-e3c6-4542-9480-466113c7704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:35.964485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d58d0d-e3c6-4542-9480-466113c7704e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:35.964772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d58d0d-e3c6-4542-9480-466113c7704e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:35.965054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d58d0d-e3c6-4542-9480-466113c7704e admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:35.967142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d58d0d-e3c6-4542-9480-466113c7704e admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:35.969074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d58d0d-e3c6-4542-9480-466113c7704e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:35.971178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 156/312] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:35.978190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:35.991434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d964d-b939-4f93-a19a-2b0f6bdd29dc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:35.999944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90c893-bb16-4cf0-bad5-a47074a73946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:36.000610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90c893-bb16-4cf0-bad5-a47074a73946 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.000894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90c893-bb16-4cf0-bad5-a47074a73946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.001174 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90c893-bb16-4cf0-bad5-a47074a73946 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.002038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90c893-bb16-4cf0-bad5-a47074a73946 admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=2a0c29736da14389888d8615f26f6f27) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:36.002385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90c893-bb16-4cf0-bad5-a47074a73946 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:36.004272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90c893-bb16-4cf0-bad5-a47074a73946 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:36.014947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 157/313] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:35 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:36.387170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884d5d-f410-403e-9b2c-dc1dff37242c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.388175 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884d5d-f410-403e-9b2c-dc1dff37242c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.388768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884d5d-f410-403e-9b2c-dc1dff37242c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.391055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 157/314] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:36.397815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e7f2-0dfe-4891-9613-84ca316b7a6d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.398708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e7f2-0dfe-4891-9613-84ca316b7a6d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.399188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e7f2-0dfe-4891-9613-84ca316b7a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.426361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7678e7f2-0dfe-4891-9613-84ca316b7a6d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:36.428550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7678e7f2-0dfe-4891-9613-84ca316b7a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:36.438998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 158/315] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:36.488948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884d5d-f410-403e-9b2c-dc1dff37242c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:36.504028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884d5d-f410-403e-9b2c-dc1dff37242c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:36.514302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:36.515096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.515642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.515916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.540015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:36.546311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:36.547873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 158/316] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:36.555487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678e7f2-0dfe-4891-9613-84ca316b7a6d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:36.567776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678e7f2-0dfe-4891-9613-84ca316b7a6d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:36.578502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:36.579478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.579966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.580464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.581456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:36.581977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:36.584385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:36.600611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 159/317] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:36.606798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:36.623162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff9063-3df5-4666-902b-5dce19f93e88 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:36.634818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:36.635483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.635773 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.636057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.650597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:36.652305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:36.668155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 159/318] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:36.674315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:36.691777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a89fe-e897-4136-bee2-e98fb1abcf35 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:36.702555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:36.703807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.704320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.704796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] PATH_INFO: `/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.710996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] RBAC: Authorizing `identity:get_project(project_id=9e90b3c560e34b33b6dbbbe37d81f1b5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:36.713090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:36.715096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 160/319] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:36 2021] GET /identity/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5 => generated 344 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:36.721369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:36.735128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb5a4c-a837-414e-a563-6dce18e842bf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:36.742370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d47636-e00c-4eae-bf6a-5f6941e57fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:36.743215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d47636-e00c-4eae-bf6a-5f6941e57fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.743502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d47636-e00c-4eae-bf6a-5f6941e57fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.743781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d47636-e00c-4eae-bf6a-5f6941e57fb0 admin admin] PATH_INFO: `/v3/groups/e023aca974d14bc08710ab75d4ae27f9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.752037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d47636-e00c-4eae-bf6a-5f6941e57fb0 admin admin] RBAC: Authorizing `identity:get_group(group_id=e023aca974d14bc08710ab75d4ae27f9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:36.754238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d47636-e00c-4eae-bf6a-5f6941e57fb0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:36.756795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 160/320] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:36 2021] GET /identity/v3/groups/e023aca974d14bc08710ab75d4ae27f9 => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:36.763123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:36.773734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f549e-e53b-4ed7-b92d-11f72d7e4b2d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:36.782284 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5dacf-f44f-4432-872d-4da98502bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:36.783202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5dacf-f44f-4432-872d-4da98502bd8c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:36.783713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5dacf-f44f-4432-872d-4da98502bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:36.784197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5dacf-f44f-4432-872d-4da98502bd8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:36.785258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5dacf-f44f-4432-872d-4da98502bd8c admin admin] RBAC: Adding query filter params (group.id=e023aca974d14bc08710ab75d4ae27f9, role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9e90b3c560e34b33b6dbbbe37d81f1b5) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:36.785787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5dacf-f44f-4432-872d-4da98502bd8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:36.788465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5dacf-f44f-4432-872d-4da98502bd8c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:36.798320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 161/321] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:36 2021] GET /identity/v3/role_assignments?group.id=e023aca974d14bc08710ab75d4ae27f9&scope.project.id=9e90b3c560e34b33b6dbbbe37d81f1b5&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:38.218741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af2ca2-76de-48f6-aa72-1e9890d0246c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.219254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af2ca2-76de-48f6-aa72-1e9890d0246c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.219254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af2ca2-76de-48f6-aa72-1e9890d0246c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.221299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 161/322] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:38.227689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7562d1-5f19-430c-aa79-d35348cf199b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.228129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7562d1-5f19-430c-aa79-d35348cf199b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.228313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7562d1-5f19-430c-aa79-d35348cf199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.255734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ac7562d1-5f19-430c-aa79-d35348cf199b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:38.256932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ac7562d1-5f19-430c-aa79-d35348cf199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:38.265297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 162/323] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:38.300806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af2ca2-76de-48f6-aa72-1e9890d0246c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.313645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af2ca2-76de-48f6-aa72-1e9890d0246c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.319005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.319784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.320060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.320329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.337449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:38.344525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:38.346144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 162/324] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:38.352470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7562d1-5f19-430c-aa79-d35348cf199b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.361770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7562d1-5f19-430c-aa79-d35348cf199b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.366538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.367203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.367482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.367757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.368528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:38.368833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:38.370468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:38.382325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 163/325] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:38.389603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.403092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcec65-ee01-4e2d-a1f5-0fcacaac1fe8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.407581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.408421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.408699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.408967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.410211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:38.412222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:38.414126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 163/326] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:38.419954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.432149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf4c8-0cdc-4565-a63c-c319502b821b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.436676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd5635-14cc-4666-879b-fcb1e0a77278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.437525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5635-14cc-4666-879b-fcb1e0a77278 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.437803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5635-14cc-4666-879b-fcb1e0a77278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.438076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5635-14cc-4666-879b-fcb1e0a77278 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.443133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd5635-14cc-4666-879b-fcb1e0a77278 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:38.445012 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd5635-14cc-4666-879b-fcb1e0a77278 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:38.447081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 164/327] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:38.452950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.463064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c5a7e-04a5-4ab5-a15c-0eef4879a741 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.474599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541c0a-b8aa-4e5e-8cd4-c23c0082fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.475388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541c0a-b8aa-4e5e-8cd4-c23c0082fd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.475668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541c0a-b8aa-4e5e-8cd4-c23c0082fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.475944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541c0a-b8aa-4e5e-8cd4-c23c0082fd48 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe/groups/54b46521962c4639a94a50e863a0f906/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.483315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541c0a-b8aa-4e5e-8cd4-c23c0082fd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549aab745e5b401181e0ecf7c85c05fe, group_id=54b46521962c4639a94a50e863a0f906, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:38.486042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541c0a-b8aa-4e5e-8cd4-c23c0082fd48 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:38.577353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 164/328] 10.222.0.11 () {58 vars in 1463 bytes} [Thu Nov 11 16:14:38 2021] PUT /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe/groups/54b46521962c4639a94a50e863a0f906/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:38.710307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637354f-a3d5-45b6-8518-a067907c0443 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.710675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637354f-a3d5-45b6-8518-a067907c0443 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.710861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637354f-a3d5-45b6-8518-a067907c0443 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.712787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 165/329] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:38.729027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0d6e5-01ee-4ac1-8ad7-8ba199e1187d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.729323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0d6e5-01ee-4ac1-8ad7-8ba199e1187d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.729504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0d6e5-01ee-4ac1-8ad7-8ba199e1187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.755431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d0a0d6e5-01ee-4ac1-8ad7-8ba199e1187d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:38.756633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d0a0d6e5-01ee-4ac1-8ad7-8ba199e1187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:38.826915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 165/330] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:38.862208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637354f-a3d5-45b6-8518-a067907c0443 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.877686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637354f-a3d5-45b6-8518-a067907c0443 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.882596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.883447 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.883725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.884047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.900632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:38.907941 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:38.909210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 166/331] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:38.915614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0d6e5-01ee-4ac1-8ad7-8ba199e1187d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.924780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0d6e5-01ee-4ac1-8ad7-8ba199e1187d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.931727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.932412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.932693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.932969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.933812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:38.934158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:38.935821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:38.945504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 166/332] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:38.953143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.965925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0ab29-ca83-4f2a-977a-d41ee4898fe5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:38.971124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c21e11-741a-4a65-9d1b-f26748a98931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:38.971950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c21e11-741a-4a65-9d1b-f26748a98931 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:38.972225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c21e11-741a-4a65-9d1b-f26748a98931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:38.972496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c21e11-741a-4a65-9d1b-f26748a98931 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:38.974289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c21e11-741a-4a65-9d1b-f26748a98931 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:38.976163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c21e11-741a-4a65-9d1b-f26748a98931 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:38.978051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 167/333] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:38.984697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:38.999385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732e4d-5ec8-4238-b16d-115d0606ce8d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.004321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0ec9-f81b-4b34-87d7-56b8a31637bc None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.005303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0ec9-f81b-4b34-87d7-56b8a31637bc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.005588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0ec9-f81b-4b34-87d7-56b8a31637bc None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.005799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.007005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.007495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.007663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 168/334] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:39.008171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.014252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.014400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd96f46-5759-46f2-ba22-8977ad7befac None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.014400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd96f46-5759-46f2-ba22-8977ad7befac None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.014400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd96f46-5759-46f2-ba22-8977ad7befac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.016640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.023230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 167/335] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:38 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:39.026290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.040695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1fd96f46-5759-46f2-ba22-8977ad7befac None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:39.041553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563d21e-e420-4b34-8300-8b3f585233dc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.041877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1fd96f46-5759-46f2-ba22-8977ad7befac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:39.046651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.047671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.047956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.048231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe/groups/54b46521962c4639a94a50e863a0f906/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.050524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] RBAC: Authorizing `identity:create_grant(project_id=549aab745e5b401181e0ecf7c85c05fe, group_id=54b46521962c4639a94a50e863a0f906, role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.053719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.058049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 169/336] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:39.081749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd96f46-5759-46f2-ba22-8977ad7befac None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.092816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd96f46-5759-46f2-ba22-8977ad7befac None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.100422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.101313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.101684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.101966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.117513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:39.128031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:39.130193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 170/337] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:39.138140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.146460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 168/338] 10.222.0.11 () {58 vars in 1463 bytes} [Thu Nov 11 16:14:39 2021] PUT /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe/groups/54b46521962c4639a94a50e863a0f906/roles/019207b971e242a29fd501b9b5a887f8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:39.153753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360e5af-da84-4db5-a8aa-193277d259be admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.216210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06164458-a0da-404d-a955-9641bff7cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.217251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06164458-a0da-404d-a955-9641bff7cc7a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.217734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06164458-a0da-404d-a955-9641bff7cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.218261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06164458-a0da-404d-a955-9641bff7cc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.219253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06164458-a0da-404d-a955-9641bff7cc7a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:39.219763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06164458-a0da-404d-a955-9641bff7cc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.221749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06164458-a0da-404d-a955-9641bff7cc7a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.237746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 171/339] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:39.247044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.263924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662314fe-3000-439b-bb4e-7410f073050e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.271056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.272288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.272794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.273289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.274823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.276971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.279350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 169/340] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:39.283298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e047dd-2763-4a7b-a3e3-c5e0951e8967 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.283865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e047dd-2763-4a7b-a3e3-c5e0951e8967 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.284331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e047dd-2763-4a7b-a3e3-c5e0951e8967 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.287009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 172/341] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:39.288217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.294665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f52d2-c53b-430a-860b-22b7337c9e1e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.294983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f52d2-c53b-430a-860b-22b7337c9e1e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.295267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f52d2-c53b-430a-860b-22b7337c9e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.306593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce5fc-f97f-4737-a906-a23396ac9fcd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.320463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-122f52d2-c53b-430a-860b-22b7337c9e1e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:39.322289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-122f52d2-c53b-430a-860b-22b7337c9e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:39.323639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.324725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.325205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.325655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.327156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.330587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.334825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 170/342] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:39.341136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.343246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 173/343] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 11 16:14:39.353358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14c5c1-def3-41f5-bbfb-7483ed4a931c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.358345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.359512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.359975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.360424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27/groups/54b46521962c4639a94a50e863a0f906/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.362969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0c29736da14389888d8615f26f6f27, group_id=54b46521962c4639a94a50e863a0f906, role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.365878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.382465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f52d2-c53b-430a-860b-22b7337c9e1e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.392711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f52d2-c53b-430a-860b-22b7337c9e1e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.398543 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.399701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.400174 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.400627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.415574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:39.425080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:39.427672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 174/344] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:39.434560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.446306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d9583-70c4-457a-8d1c-975e4bb1ef20 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.454057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.454819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.455099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.455374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.458144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:39.458144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.458907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.474460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 175/345] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:39.476836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 171/346] 10.222.0.11 () {58 vars in 1463 bytes} [Thu Nov 11 16:14:39 2021] PUT /identity/v3/projects/2a0c29736da14389888d8615f26f6f27/groups/54b46521962c4639a94a50e863a0f906/roles/019207b971e242a29fd501b9b5a887f8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:14:39.477994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.488470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90026-63d3-4d14-b341-607362c045be admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.562573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.563437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.563717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.563989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.567130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.569547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.572089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 176/347] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:39.578234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.592149 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec6644-c496-43ef-89b6-dfadbcb6a5fb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.596922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bedf7-76ee-4d71-a0d7-9b7c2cc1e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.598088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bedf7-76ee-4d71-a0d7-9b7c2cc1e634 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.598612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bedf7-76ee-4d71-a0d7-9b7c2cc1e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.599089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bedf7-76ee-4d71-a0d7-9b7c2cc1e634 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.600550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bedf7-76ee-4d71-a0d7-9b7c2cc1e634 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.602820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bedf7-76ee-4d71-a0d7-9b7c2cc1e634 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.610734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 172/348] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:39.617764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.631683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a812a-08f0-4687-a883-f104c64bbcc9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.636629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.637734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.638262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.638736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27/groups/54b46521962c4639a94a50e863a0f906/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.641207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0c29736da14389888d8615f26f6f27, group_id=54b46521962c4639a94a50e863a0f906, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.644092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.658521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33205c-aafa-495e-9003-5acd6e7b1585 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.659202 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33205c-aafa-495e-9003-5acd6e7b1585 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.659680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33205c-aafa-495e-9003-5acd6e7b1585 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.662235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 173/349] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:39.668192 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799446dc-0ed8-407e-91ee-86834d7aabb1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.668574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799446dc-0ed8-407e-91ee-86834d7aabb1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.668920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799446dc-0ed8-407e-91ee-86834d7aabb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.688666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-799446dc-0ed8-407e-91ee-86834d7aabb1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:39.694848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-799446dc-0ed8-407e-91ee-86834d7aabb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:39.698636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 174/350] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:39.720453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 177/351] 10.222.0.11 () {58 vars in 1463 bytes} [Thu Nov 11 16:14:39 2021] PUT /identity/v3/projects/2a0c29736da14389888d8615f26f6f27/groups/54b46521962c4639a94a50e863a0f906/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:39.725406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799446dc-0ed8-407e-91ee-86834d7aabb1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.735365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799446dc-0ed8-407e-91ee-86834d7aabb1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.810915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.810915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.811158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.811242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.825694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:39.832743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:39.834442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 175/352] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:39.841424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.856469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b1f7-4df2-4b73-bf09-726b243ccd8c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.865562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.866298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.866581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.866880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.867633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:39.867943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.869609 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.883183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 178/353] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:39.891411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.904076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f6c9c-f02c-4d97-a1c6-97732c5d4fd6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.915171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.916038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.916317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.916591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] PATH_INFO: `/v3/groups/e023aca974d14bc08710ab75d4ae27f9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.923194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] RBAC: Authorizing `identity:get_group(group_id=e023aca974d14bc08710ab75d4ae27f9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.925143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.927712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 176/354] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/groups/e023aca974d14bc08710ab75d4ae27f9 => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:39.933810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.947752 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0fa7-2535-4d81-a5df-333b3b1def1c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.952239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b408e-4bee-4b37-96f1-7b52c52451eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.953114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b408e-4bee-4b37-96f1-7b52c52451eb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.953396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b408e-4bee-4b37-96f1-7b52c52451eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.953671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b408e-4bee-4b37-96f1-7b52c52451eb admin admin] PATH_INFO: `/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:39.954930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b408e-4bee-4b37-96f1-7b52c52451eb admin admin] RBAC: Authorizing `identity:get_project(project_id=9e90b3c560e34b33b6dbbbe37d81f1b5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:39.956764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b408e-4bee-4b37-96f1-7b52c52451eb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:39.966970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 179/355] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:39 2021] GET /identity/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5 => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:39.974439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:39.987548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97445747-7f19-4d0a-9fbf-7ffbbe001ec0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:39.996877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea79f8-77c5-41e9-8dc8-2da796b117e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:39.997776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea79f8-77c5-41e9-8dc8-2da796b117e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:39.998065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea79f8-77c5-41e9-8dc8-2da796b117e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:39.998351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea79f8-77c5-41e9-8dc8-2da796b117e0 admin admin] PATH_INFO: `/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5/groups/e023aca974d14bc08710ab75d4ae27f9/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:40.003638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea79f8-77c5-41e9-8dc8-2da796b117e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e90b3c560e34b33b6dbbbe37d81f1b5, group_id=e023aca974d14bc08710ab75d4ae27f9, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:40.006920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea79f8-77c5-41e9-8dc8-2da796b117e0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:40.091859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 177/356] 10.222.0.11 () {58 vars in 1463 bytes} [Thu Nov 11 16:14:39 2021] PUT /identity/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5/groups/e023aca974d14bc08710ab75d4ae27f9/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:41.757548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195dbca-7b08-43e0-9819-8c39beaf676c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:41.758595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195dbca-7b08-43e0-9819-8c39beaf676c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:41.759089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195dbca-7b08-43e0-9819-8c39beaf676c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:41.761053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 180/357] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:41.767535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cf997-580c-4663-a001-a546675bf20c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:41.768346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cf997-580c-4663-a001-a546675bf20c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:41.768834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cf997-580c-4663-a001-a546675bf20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:41.795336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c54cf997-580c-4663-a001-a546675bf20c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:41.796877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c54cf997-580c-4663-a001-a546675bf20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:41.870158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 178/358] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:41.919634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195dbca-7b08-43e0-9819-8c39beaf676c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:41.934737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195dbca-7b08-43e0-9819-8c39beaf676c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:41.939492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:41.940485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:41.940991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:41.941645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:41.954910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:41.962366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:41.963821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 181/359] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:41.970343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cf997-580c-4663-a001-a546675bf20c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:41.980583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cf997-580c-4663-a001-a546675bf20c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:41.987371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:41.988531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:41.989010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:41.989477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:41.990486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:41.991002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:41.992795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.004150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 179/360] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.010461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.021937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02509-f17f-49b0-88da-2631645e4470 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.034032 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.035594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.036069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.036550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.050468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.053063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.062957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 182/361] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:42.068965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.083876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145e1e2-06f5-453b-921c-bb06b03c1758 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.093040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.093902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.094203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.094482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.099115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.101238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.103358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 180/362] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.109452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.119524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93310b98-5fe4-4bd1-9330-df2431336ec0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.135377 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100668c-88b3-4280-940d-4627aa4e5056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.136235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100668c-88b3-4280-940d-4627aa4e5056 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.136516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100668c-88b3-4280-940d-4627aa4e5056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.136788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100668c-88b3-4280-940d-4627aa4e5056 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.138001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100668c-88b3-4280-940d-4627aa4e5056 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.140202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100668c-88b3-4280-940d-4627aa4e5056 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.142106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 183/363] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.148354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.163774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59f92c-ea63-44fe-8ba1-a1c65f5d5640 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.173457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4beb4-24df-4689-ba51-4ea61ff0503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.174104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4beb4-24df-4689-ba51-4ea61ff0503c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.174412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4beb4-24df-4689-ba51-4ea61ff0503c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.174685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4beb4-24df-4689-ba51-4ea61ff0503c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.176141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4beb4-24df-4689-ba51-4ea61ff0503c admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=549aab745e5b401181e0ecf7c85c05fe) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:42.176451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4beb4-24df-4689-ba51-4ea61ff0503c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.178304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4beb4-24df-4689-ba51-4ea61ff0503c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.191136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 181/364] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 611 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.444593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f950-ce14-461e-aeb2-12f3480fda20 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.444940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f950-ce14-461e-aeb2-12f3480fda20 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.445223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638f950-ce14-461e-aeb2-12f3480fda20 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.447291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 184/365] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:42.453660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44079f-45b8-4b2a-8377-49adfcffb929 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.454263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44079f-45b8-4b2a-8377-49adfcffb929 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.454741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44079f-45b8-4b2a-8377-49adfcffb929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.473471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0d44079f-45b8-4b2a-8377-49adfcffb929 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:42.475001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0d44079f-45b8-4b2a-8377-49adfcffb929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:42.490255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 182/366] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:42.518138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638f950-ce14-461e-aeb2-12f3480fda20 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.534154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638f950-ce14-461e-aeb2-12f3480fda20 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.543284 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.544362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.544850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.545335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.561276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:42.571286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:42.573100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 185/367] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:42.579164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44079f-45b8-4b2a-8377-49adfcffb929 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.592106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44079f-45b8-4b2a-8377-49adfcffb929 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.601679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.602376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.602657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.602931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.603715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:42.604019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.608398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.621156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 183/368] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.627295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.639943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e11f82-e81a-4f2a-ab2e-44d41be81b6c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.647902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6caea-a2f5-49f8-96ac-65f9fe0f4e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.648863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6caea-a2f5-49f8-96ac-65f9fe0f4e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.649369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6caea-a2f5-49f8-96ac-65f9fe0f4e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.649896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6caea-a2f5-49f8-96ac-65f9fe0f4e89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.659546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6caea-a2f5-49f8-96ac-65f9fe0f4e89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.661861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6caea-a2f5-49f8-96ac-65f9fe0f4e89 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.673885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 186/369] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:42.680195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.687762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c81ef-8340-4bab-a4f9-fd492f5c0dca None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.688384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c81ef-8340-4bab-a4f9-fd492f5c0dca None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.688883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c81ef-8340-4bab-a4f9-fd492f5c0dca None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.691397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 187/370] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:42.693396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec54b5e-b6be-4dd6-bb71-21e265f9b175 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.698413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.699216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.699498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.699776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.700463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74a37-077e-4b9a-a039-c722f2a67090 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.700952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74a37-077e-4b9a-a039-c722f2a67090 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.701121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.701585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74a37-077e-4b9a-a039-c722f2a67090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.703237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.705144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 184/371] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.712505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.724640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-04a74a37-077e-4b9a-a039-c722f2a67090 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:42.726338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-04a74a37-077e-4b9a-a039-c722f2a67090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:42.726451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6564be-26a9-4070-84fe-bd7b15baaa53 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.733531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.734661 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.734951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.735226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.736448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.737848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 188/372] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:42.742282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.742282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 185/373] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.746581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a74a37-077e-4b9a-a039-c722f2a67090 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.759759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a74a37-077e-4b9a-a039-c722f2a67090 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.765124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.765855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.766259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.766541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.767533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=549aab745e5b401181e0ecf7c85c05fe) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:42.767852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.770446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.780287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.781304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 189/374] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=549aab745e5b401181e0ecf7c85c05fe&role.id=019207b971e242a29fd501b9b5a887f8 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.795422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be4bd-0567-46ea-b3d2-181bf2c375d3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.803041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9576a39-a0a0-4ca0-8704-22ee417f8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.803922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9576a39-a0a0-4ca0-8704-22ee417f8f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.804211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9576a39-a0a0-4ca0-8704-22ee417f8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.804543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9576a39-a0a0-4ca0-8704-22ee417f8f22 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.821228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9576a39-a0a0-4ca0-8704-22ee417f8f22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:42.829629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b9576a39-a0a0-4ca0-8704-22ee417f8f22 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:14:42.831316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 186/375] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:42.838291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.855697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139bfe2-575d-4b49-869e-5f447e3ebc13 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.860609 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.861402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.861691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.861974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.863825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9379a-ae71-40d5-b15e-3d04577397c8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.864163 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9379a-ae71-40d5-b15e-3d04577397c8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.864443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9379a-ae71-40d5-b15e-3d04577397c8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.864660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:42.864985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.866681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 187/376] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:42.866794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.873256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45b255-bf5e-47b2-a0ab-ea535aedb524 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.873563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45b255-bf5e-47b2-a0ab-ea535aedb524 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.873822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45b255-bf5e-47b2-a0ab-ea535aedb524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.884650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 190/377] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:42.891322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.893450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0a45b255-bf5e-47b2-a0ab-ea535aedb524 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:42.894834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0a45b255-bf5e-47b2-a0ab-ea535aedb524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:42.902846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 188/378] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:42.905730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9ab40-295b-4073-ae03-dcf3eec93eb6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.913799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.914958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.915439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.915991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.921040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8aaf-be9b-4a9a-af4c-fa69e54914cb None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.921334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8aaf-be9b-4a9a-af4c-fa69e54914cb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.921623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d8aaf-be9b-4a9a-af4c-fa69e54914cb None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.923447 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 189/379] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:42.926792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.929245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:42.929978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f6d4-ac1f-4d0c-aa3a-b2af5c7f73e8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.930351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f6d4-ac1f-4d0c-aa3a-b2af5c7f73e8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.930636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f6d4-ac1f-4d0c-aa3a-b2af5c7f73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.941757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 191/380] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:14:42.943043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.953694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575aed6-b985-468a-8b66-1b828e9d3a6c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.955140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e0e4f6d4-ac1f-4d0c-aa3a-b2af5c7f73e8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:42.956827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e0e4f6d4-ac1f-4d0c-aa3a-b2af5c7f73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:42.959916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.961014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.961299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.961568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.968492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 190/381] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:42.970625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f6d4-ac1f-4d0c-aa3a-b2af5c7f73e8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.976047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:42.983494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:42.984844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 192/382] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:42.985315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f6d4-ac1f-4d0c-aa3a-b2af5c7f73e8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:42.991495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:42.991903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:42.992830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:42.993347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:42.993828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:42.995331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:42.997660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.000719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 191/383] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.004113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35bf6d-f8b9-484d-8fdb-6fb5b45d3ba3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.008011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.008897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.009569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.009847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.010121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.010969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:43.011279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.012927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.021147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f55ad-f130-4719-b5b9-f5fb50a26a44 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.024288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 193/384] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:43.024943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.029333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.030251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.030838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.031088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.033102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.035576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.035894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20dcef-ceeb-4e52-be92-a81ce7dbc597 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.037592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 192/385] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.038109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.041433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.042351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.042700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.043074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.050752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725945c-ff58-49ed-bf30-d2c0f85b6bbe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.055951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:43.056402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.057106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.057444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.057723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.063210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:14:43.065089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 194/386] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:43.065343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.067764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.069840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.077026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765e3f4-61fe-45f1-a4ad-29232805df4e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.081032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 193/387] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:43.081696 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.081945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.082476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.082826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.083236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.084090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=f2eb341fe747486eb32039f7dcda8bc2, scope.project.id=2a0c29736da14389888d8615f26f6f27) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:43.084473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.086440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.092933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe06d0-e20d-4883-91c6-d953c547fb65 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.096818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 195/388] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=f2eb341fe747486eb32039f7dcda8bc2 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.097882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.098618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.099417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.099702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.099975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.100928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:43.101343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.102989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.114801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 194/389] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.116496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31a1a-7511-41dc-a1a2-94a8f28db2f9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.121189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.122716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.123826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.124348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.124829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.126687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.130662 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.137835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 196/390] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.138030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79b83-c7ed-4dfb-bf0b-b7ccc40f00b2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.139784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.142416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.143076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.143353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.143636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.151886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14350aa0-2fbd-4f76-ab99-e1c7680f5958 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.153288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.155151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.156913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.157902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.158357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.158760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] PATH_INFO: `/v3/groups/54b46521962c4639a94a50e863a0f906` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.160354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=54b46521962c4639a94a50e863a0f906)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.162495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.164558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 197/391] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/groups/54b46521962c4639a94a50e863a0f906 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:43.166153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 195/392] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:14:43.176476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.177740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.188457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7c11-1718-432d-9ab7-4355cc765b46 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.189213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9cb8-a22a-4826-9f11-282d09d9b4f4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.195950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.196324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.196996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.197283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.197562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.197916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.198429 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.198530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] RBAC: Adding query filter params (group.id=54b46521962c4639a94a50e863a0f906, role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=2a0c29736da14389888d8615f26f6f27) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:43.198773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.199152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] PATH_INFO: `/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.200741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.201318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=9e90b3c560e34b33b6dbbbe37d81f1b5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.203786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.206284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 196/393] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.210394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 198/394] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/role_assignments?group.id=54b46521962c4639a94a50e863a0f906&scope.project.id=2a0c29736da14389888d8615f26f6f27&role.id=019207b971e242a29fd501b9b5a887f8 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.213491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.224460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3dd3e-1ae6-48d9-8b98-fd02e0e05cc4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.229366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc522a-09d7-4e66-8d99-7adad8b1bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.230328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc522a-09d7-4e66-8d99-7adad8b1bc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.230617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc522a-09d7-4e66-8d99-7adad8b1bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.230895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc522a-09d7-4e66-8d99-7adad8b1bc6f admin admin] PATH_INFO: `/v3/groups/e023aca974d14bc08710ab75d4ae27f9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.232168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc522a-09d7-4e66-8d99-7adad8b1bc6f admin admin] RBAC: Authorizing `identity:get_group(group_id=e023aca974d14bc08710ab75d4ae27f9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.234141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc522a-09d7-4e66-8d99-7adad8b1bc6f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.236048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 197/395] 10.222.0.11 () {56 vars in 1201 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/groups/e023aca974d14bc08710ab75d4ae27f9 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:43.243549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:43.254700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492666-f1a1-4875-8d35-13e134bbfbf7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:43.259675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adfc95-ad06-4117-9887-8e27653c0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:43.260352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adfc95-ad06-4117-9887-8e27653c0287 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:43.260640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adfc95-ad06-4117-9887-8e27653c0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:43.260921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adfc95-ad06-4117-9887-8e27653c0287 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:43.261788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adfc95-ad06-4117-9887-8e27653c0287 admin admin] RBAC: Adding query filter params (group.id=e023aca974d14bc08710ab75d4ae27f9, role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9e90b3c560e34b33b6dbbbe37d81f1b5) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:43.262131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adfc95-ad06-4117-9887-8e27653c0287 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:43.264360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adfc95-ad06-4117-9887-8e27653c0287 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:43.272337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 199/396] 10.222.0.11 () {56 vars in 1397 bytes} [Thu Nov 11 16:14:43 2021] GET /identity/v3/role_assignments?group.id=e023aca974d14bc08710ab75d4ae27f9&scope.project.id=9e90b3c560e34b33b6dbbbe37d81f1b5&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:46.380468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee079-3819-4082-8376-1a6cf53e9b05 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.380998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee079-3819-4082-8376-1a6cf53e9b05 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.380998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee079-3819-4082-8376-1a6cf53e9b05 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.382976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 198/397] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:46.389553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6972bab-b015-461b-9357-8975ace9a2e3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.389971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6972bab-b015-461b-9357-8975ace9a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.390144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6972bab-b015-461b-9357-8975ace9a2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.415418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e6972bab-b015-461b-9357-8975ace9a2e3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:46.416660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e6972bab-b015-461b-9357-8975ace9a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:46.425501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 200/398] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:46.467938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e8d59-a4ed-432c-b429-8ecc60916561 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.468260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e8d59-a4ed-432c-b429-8ecc60916561 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.468495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e8d59-a4ed-432c-b429-8ecc60916561 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.470307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 199/399] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:46.471901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6972bab-b015-461b-9357-8975ace9a2e3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.482064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931fa7-3909-448b-8607-97d2e5138c2c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.482379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931fa7-3909-448b-8607-97d2e5138c2c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.482660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931fa7-3909-448b-8607-97d2e5138c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.494412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6972bab-b015-461b-9357-8975ace9a2e3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.506073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a5931fa7-3909-448b-8607-97d2e5138c2c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:46.507297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a5931fa7-3909-448b-8607-97d2e5138c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:46.510536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36acdd-a3ee-4b43-9c52-cbcd5d289c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.511344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36acdd-a3ee-4b43-9c52-cbcd5d289c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.511608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36acdd-a3ee-4b43-9c52-cbcd5d289c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.518432 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36acdd-a3ee-4b43-9c52-cbcd5d289c76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.528897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36acdd-a3ee-4b43-9c52-cbcd5d289c76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.530812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36acdd-a3ee-4b43-9c52-cbcd5d289c76 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.532623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 200/400] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:46.555703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ca36acdd-a3ee-4b43-9c52-cbcd5d289c76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:46.557165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 201/401] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:46.563226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931fa7-3909-448b-8607-97d2e5138c2c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.567716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b0e45-3dd6-4287-a8e7-5ef23e15acd1 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.568001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b0e45-3dd6-4287-a8e7-5ef23e15acd1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.568277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b0e45-3dd6-4287-a8e7-5ef23e15acd1 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.570716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 202/402] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:46.576304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6b05-2063-4390-a718-aa2a984190e3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.576589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6b05-2063-4390-a718-aa2a984190e3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.576865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6b05-2063-4390-a718-aa2a984190e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.584703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931fa7-3909-448b-8607-97d2e5138c2c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.589088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.589743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.590026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.590340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.591089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:46.591389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.592966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.597694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8c8a6b05-2063-4390-a718-aa2a984190e3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:46.599117 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8c8a6b05-2063-4390-a718-aa2a984190e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:46.607818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 203/404] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:46.614199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6b05-2063-4390-a718-aa2a984190e3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.614319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 201/404] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:46.614319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.623418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5483b-4606-4e29-9a05-dd1078d32504 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.627093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6b05-2063-4390-a718-aa2a984190e3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.628353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.629011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.629291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.629564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.630316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.631374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:46.631374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:46.631374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:46.632521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.640905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.641698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.641983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.642286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.653167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.655063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.672554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:46.673751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 204/405] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:46.674595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.687571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e9c9-4a78-4fdb-a701-198969f1071d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.692583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.693310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.693591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.693868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.703802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.705723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.718334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 202/406] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:46 2021] POST /identity/v3/users => generated 246 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:46.719339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.740950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:46.742241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 205/407] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:46.748964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.753996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112031d5-7fbb-4475-aed9-c15e6423ec2b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.761369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957bade-b7c5-4283-b5b7-480903905a35 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.767542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.769144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.770349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.770845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.772116 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:46.773117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.773911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.775832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.776786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.777255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.777708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.778707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:46.780886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.782197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:46.782197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:46.782197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:46.784801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.805291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 203/408] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:46.812499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.821404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 206/409] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:46.830109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a11c40-5257-4083-9a1a-02ee5737d20d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.832080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:46.843839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcb8ee-70d0-42b8-a809-f0f867ad9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.844825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcb8ee-70d0-42b8-a809-f0f867ad9864 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.845388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcb8ee-70d0-42b8-a809-f0f867ad9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.845845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcb8ee-70d0-42b8-a809-f0f867ad9864 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.847018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcb8ee-70d0-42b8-a809-f0f867ad9864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.849449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bcb8e-b7a2-4b3e-858b-62037ec6aafb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:46.851747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcb8ee-70d0-42b8-a809-f0f867ad9864 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.865879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dadc57-6054-4226-87e3-4a408169f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:46.866939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dadc57-6054-4226-87e3-4a408169f43a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:46.867421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dadc57-6054-4226-87e3-4a408169f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:46.867885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dadc57-6054-4226-87e3-4a408169f43a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:46.868887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dadc57-6054-4226-87e3-4a408169f43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:46.871234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dadc57-6054-4226-87e3-4a408169f43a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:46.958949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 204/410] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:46 2021] POST /identity/v3/users => generated 248 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:14:46.993718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 207/411] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:46 2021] POST /identity/v3/users => generated 248 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:14:47.027830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5beff8-8851-4267-8653-cd6861095bd5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.028498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5beff8-8851-4267-8653-cd6861095bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.029055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5beff8-8851-4267-8653-cd6861095bd5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.031318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 205/412] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:47.038341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de723038-7351-4358-8b96-fa2e250b322f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.038689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de723038-7351-4358-8b96-fa2e250b322f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.038911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de723038-7351-4358-8b96-fa2e250b322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.060464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-de723038-7351-4358-8b96-fa2e250b322f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:47.061708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-de723038-7351-4358-8b96-fa2e250b322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:47.071444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 208/413] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:47.099992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5beff8-8851-4267-8653-cd6861095bd5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:47.118128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5beff8-8851-4267-8653-cd6861095bd5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:47.123983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:47.124916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.125273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.125625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.140127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:47.142011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:47.161211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:47.162869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 206/414] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:47.169410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de723038-7351-4358-8b96-fa2e250b322f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:47.181969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de723038-7351-4358-8b96-fa2e250b322f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:47.188033 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59266578-e3d7-4f87-9891-cdec91b5dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:47.189076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266578-e3d7-4f87-9891-cdec91b5dbcf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.189550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266578-e3d7-4f87-9891-cdec91b5dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.190723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59266578-e3d7-4f87-9891-cdec91b5dbcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.192374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59266578-e3d7-4f87-9891-cdec91b5dbcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:47.192912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59266578-e3d7-4f87-9891-cdec91b5dbcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:47.195462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59266578-e3d7-4f87-9891-cdec91b5dbcf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:47.212860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 209/415] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:47.217083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:47.229414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9131-f5fb-4bed-ab22-d769adeae2b4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:47.234538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131518f8-04f1-4427-bdd0-6dc49a3e8514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:47.235446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131518f8-04f1-4427-bdd0-6dc49a3e8514 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.235902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131518f8-04f1-4427-bdd0-6dc49a3e8514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.236307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131518f8-04f1-4427-bdd0-6dc49a3e8514 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.237932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131518f8-04f1-4427-bdd0-6dc49a3e8514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:47.240192 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131518f8-04f1-4427-bdd0-6dc49a3e8514 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:47.432891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 207/416] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:47 2021] POST /identity/v3/users => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:14:47.535232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd886d0-e32e-4395-b15b-a6234c77744b None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.535718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd886d0-e32e-4395-b15b-a6234c77744b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.535718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd886d0-e32e-4395-b15b-a6234c77744b None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.537734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 210/417] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:47.544410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab03cd-94e3-422d-a47c-9f8700fc9620 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.544707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab03cd-94e3-422d-a47c-9f8700fc9620 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.544982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab03cd-94e3-422d-a47c-9f8700fc9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.570914 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b1ab03cd-94e3-422d-a47c-9f8700fc9620 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:47.572200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b1ab03cd-94e3-422d-a47c-9f8700fc9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:47.586430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 208/418] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:47.627779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd886d0-e32e-4395-b15b-a6234c77744b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:47.644848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd886d0-e32e-4395-b15b-a6234c77744b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:47.652659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:47.653344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.653623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.653894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.654711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:47.656358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:47.707182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.sql.core [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 11 16:14:47.707182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 11 16:14:47.707182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [parameters: {'id': 'ca4732ef6aa3449d93f8e10a2d801144', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 11 16:14:47.707182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 11 16:14:47.722440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 11 16:14:47.723992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 211/419] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:14:47 2021] POST /identity/v3/roles => generated 144 bytes in 97 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:47.731831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab03cd-94e3-422d-a47c-9f8700fc9620 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:47.741256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab03cd-94e3-422d-a47c-9f8700fc9620 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:47.748812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb156f-d4f1-4d40-9381-152d32864174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:47.749612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb156f-d4f1-4d40-9381-152d32864174 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.749887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb156f-d4f1-4d40-9381-152d32864174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.750160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb156f-d4f1-4d40-9381-152d32864174 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.760670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb156f-d4f1-4d40-9381-152d32864174 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:47.768790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-07fb156f-d4f1-4d40-9381-152d32864174 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:14:47.770191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 209/420] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:14:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:47.776598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:47.788579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772afcda-6e85-45e9-8728-e39431080d95 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:47.793087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa517693-9c30-44ec-af04-f9ab5aa214d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:47.793731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517693-9c30-44ec-af04-f9ab5aa214d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:47.794057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517693-9c30-44ec-af04-f9ab5aa214d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:47.794372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa517693-9c30-44ec-af04-f9ab5aa214d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:47.795125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa517693-9c30-44ec-af04-f9ab5aa214d0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:47.795427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa517693-9c30-44ec-af04-f9ab5aa214d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:47.797093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa517693-9c30-44ec-af04-f9ab5aa214d0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:47.806241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 212/421] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:49.867031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f63b-d4d9-4eee-ab37-248c1dd4763e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.867516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f63b-d4d9-4eee-ab37-248c1dd4763e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.867516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f63b-d4d9-4eee-ab37-248c1dd4763e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:49.869551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 210/422] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:49.871137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346335-7e50-47b1-a05f-050f0feb18f8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.871515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346335-7e50-47b1-a05f-050f0feb18f8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.871717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346335-7e50-47b1-a05f-050f0feb18f8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:49.873465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 213/423] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:49.879906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb16ab-14da-4c07-a015-2f2ef1a68549 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.880068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34388659-95bd-4c98-801f-3a332266587a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.880250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb16ab-14da-4c07-a015-2f2ef1a68549 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.880343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34388659-95bd-4c98-801f-3a332266587a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.880487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34388659-95bd-4c98-801f-3a332266587a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:49.880574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb16ab-14da-4c07-a015-2f2ef1a68549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:49.910330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-34388659-95bd-4c98-801f-3a332266587a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:49.911261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f8fb16ab-14da-4c07-a015-2f2ef1a68549 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:49.911526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-34388659-95bd-4c98-801f-3a332266587a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:49.912459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f8fb16ab-14da-4c07-a015-2f2ef1a68549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:49.919623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 211/424] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:49.932348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 214/425] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:49.945762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34388659-95bd-4c98-801f-3a332266587a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:49.959750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b832-567a-4635-a001-d7c2bbccc348 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.960042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b832-567a-4635-a001-d7c2bbccc348 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.960329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781b832-567a-4635-a001-d7c2bbccc348 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:49.960493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34388659-95bd-4c98-801f-3a332266587a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:49.962452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 215/426] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:49.965945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781b832-567a-4635-a001-d7c2bbccc348 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:49.966128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d34d5-a119-40ac-88fc-b8d549d09f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:49.967169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d34d5-a119-40ac-88fc-b8d549d09f0f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.967453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d34d5-a119-40ac-88fc-b8d549d09f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.967834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d34d5-a119-40ac-88fc-b8d549d09f0f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:49.980662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d34d5-a119-40ac-88fc-b8d549d09f0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:49.982526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781b832-567a-4635-a001-d7c2bbccc348 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:49.987588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:49.988527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.988877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.989223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:49.989517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5d6d34d5-a119-40ac-88fc-b8d549d09f0f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:49.991367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 212/427] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:49.992565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f86a7-94fa-4491-ad6e-480325d50530 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:49.992847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f86a7-94fa-4491-ad6e-480325d50530 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:49.993124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f86a7-94fa-4491-ad6e-480325d50530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.009018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:50.012965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-102f86a7-94fa-4491-ad6e-480325d50530 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:50.014157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-102f86a7-94fa-4491-ad6e-480325d50530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:50.019118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:50.020653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 216/428] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:50.021430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.028391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 213/429] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:50.029465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f86a7-94fa-4491-ad6e-480325d50530 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.038232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e93eb-19ef-42a6-8e54-c915257f366a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.042792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.043442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.043677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f86a7-94fa-4491-ad6e-480325d50530 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.043863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.044012 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.044743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.045049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.046691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.048006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.048671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.050261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.050552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.056387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 217/430] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.057222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.057623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.059328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.062578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.078173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 214/431] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:50.079016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.082728 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267578c-4423-4893-8e0f-79d510b1c2bb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.089675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.091089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.091379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.091949 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.094144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20bceb-1a7a-47d0-b87f-330ca23ce49d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.099929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.101123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.101410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.101969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.102680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.105042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.115285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:50.123321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:50.124748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.126210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 218/433] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:50.127048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.128508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 215/433] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.133615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.142394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11daa-f4f9-4f73-9269-329406b9f16f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.148014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85c5a8-ff05-415a-b207-45f026e16a33 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.148375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.149151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.149438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.149716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.153196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.153845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.154127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.154444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.155229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.155535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.157617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.161198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.163533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.171674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 216/434] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.172646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.184128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01fcdb-08d8-46ff-aff7-0ad6d1bb655b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.187865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.189371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 219/435] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.190442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.191789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.192186 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.192603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.193610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.194056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.196119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.196292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.210356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a82e0-e69e-4aa6-87f7-1e09d9a87ef5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.210996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 217/436] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.211842 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.219475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.220253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.220534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.221603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.226985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2a13e-c211-496d-925c-83ec75ed0fde admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.230935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.231505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.232162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.232444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.232717 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.233161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.233462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.233767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.235382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.248080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 218/437] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.248984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.255701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:14:50.257047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 220/438] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.261808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.272445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4d36c-e572-4f0b-8e65-d66e54aa419d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.272607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d5cf2-2493-41bc-8cd7-ac68518cc3b0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.277442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.278071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.278382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.278727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.279074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.279789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.280306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.280783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.288486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.290642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.294916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.297126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.305470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:14:50.312346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 221/439] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.312346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.319074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad82f79-6e82-419a-b749-ac39a47e894b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.323790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.324512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.324872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.325217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.326155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.327059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.327984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.328792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 219/440] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.329829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.334863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:50.334863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:50.334863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:50.336042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.341067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49337-7fdf-4cee-90ae-4752b811cbeb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.346806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.347817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.348285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.348766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.349843 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.350437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.352738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:50.352738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:50.352738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:50.354347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.386304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 222/441] 10.222.0.11 () {56 vars in 1158 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.386304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.393968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513e511-bd29-45f4-9619-6d97bf564094 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.399550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.400336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.400721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.401050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.401945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.402330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.404275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.410703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 220/442] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.411767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.423778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7321c5d-d209-444a-8e57-21cd06006a20 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.430249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 223/443] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.431412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.435127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.436011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.436525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.436982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.444591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc22f-3677-47da-94ca-801dba81e72f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.448030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.450327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.450327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.450327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.450599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.452223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.459639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.462077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.463988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 221/444] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:50.469917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.479738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 224/445] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:50.480878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.485912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86af62-2728-4928-809a-45c9112e294e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.492240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.492890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c868-40de-472a-8ef4-4df8d02db7d3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.493071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.493315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.493588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.499147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2cc93-a189-435a-a048-294efc996c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.500258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2cc93-a189-435a-a048-294efc996c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.501049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2cc93-a189-435a-a048-294efc996c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.501540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.501649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2cc93-a189-435a-a048-294efc996c62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.504821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.515650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2cc93-a189-435a-a048-294efc996c62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.518949 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2cc93-a189-435a-a048-294efc996c62 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.520771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 11 16:14:50.526293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 222/446] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.527330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.538677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57d380-c605-4700-85e2-47f3751e8e8e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.541578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6bd2cc93-a189-435a-a048-294efc996c62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.543969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.544809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.545098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.545375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.546259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 225/447] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.548107 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72615-8abd-4f27-a9e9-f17833d6303c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.548600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72615-8abd-4f27-a9e9-f17833d6303c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.549058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db72615-8abd-4f27-a9e9-f17833d6303c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.551313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 226/448] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:50.552147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db72615-8abd-4f27-a9e9-f17833d6303c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.558646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.560692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.566321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db72615-8abd-4f27-a9e9-f17833d6303c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.570621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930d0b-a138-446c-867b-0d4b060ac975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.571271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930d0b-a138-446c-867b-0d4b060ac975 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.571555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930d0b-a138-446c-867b-0d4b060ac975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.571832 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930d0b-a138-446c-867b-0d4b060ac975 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.572689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2930d0b-a138-446c-867b-0d4b060ac975 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.573002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2930d0b-a138-446c-867b-0d4b060ac975 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.574872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2930d0b-a138-446c-867b-0d4b060ac975 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.581846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.583556 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 223/449] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.584585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.598438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bbdc4-cf3a-4acd-94cc-19f1008f1a4b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.599008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 227/450] 10.222.0.11 () {56 vars in 1158 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.600156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99415bb-d255-40f3-8c47-a632afc06553 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.600405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99415bb-d255-40f3-8c47-a632afc06553 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.600681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99415bb-d255-40f3-8c47-a632afc06553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.605485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.606134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.606442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.606720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.607465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.607789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.609350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.618831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e99415bb-d255-40f3-8c47-a632afc06553 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:50.620250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e99415bb-d255-40f3-8c47-a632afc06553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:50.621270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 224/451] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.622155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.631945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 228/452] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:50.632938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99415bb-d255-40f3-8c47-a632afc06553 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.636162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814950ff-0e13-4529-bcf4-afcc99307f99 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.640899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.641486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.641766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.642042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.643944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.644259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.644860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99415bb-d255-40f3-8c47-a632afc06553 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.645847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.649826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.650678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.651161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.651611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.659316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 225/453] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.660037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.660715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.662786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.669834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adc3be-174d-49b3-91d9-76280f186c40 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.672972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 229/454] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:50.674529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.675939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cc560-b255-4996-9bac-bf7320904dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.676725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cc560-b255-4996-9bac-bf7320904dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.677009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cc560-b255-4996-9bac-bf7320904dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.677286 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cc560-b255-4996-9bac-bf7320904dbc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.684289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da9a4d-9732-498b-a1c8-69b2fe135625 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.684511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cc560-b255-4996-9bac-bf7320904dbc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.686508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cc560-b255-4996-9bac-bf7320904dbc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.688535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.689279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.690151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.690468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.697141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.699124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.700243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-cb9cc560-b255-4996-9bac-bf7320904dbc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:50.701402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 226/455] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.702742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71221b5f-ec6b-44ee-aac0-fb302eaf94ff None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.703035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71221b5f-ec6b-44ee-aac0-fb302eaf94ff None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.703321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71221b5f-ec6b-44ee-aac0-fb302eaf94ff None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.706879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 227/456] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:50.706879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71221b5f-ec6b-44ee-aac0-fb302eaf94ff None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.711890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:50.713055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 230/457] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.713805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.719454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71221b5f-ec6b-44ee-aac0-fb302eaf94ff None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.723533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc26de0-135b-41a9-85df-eaeb119f21cd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.724230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.724970 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.725248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.725516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.727896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ee09f-b83c-476d-a092-66dd6fc91731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.728604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee09f-b83c-476d-a092-66dd6fc91731 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.728884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee09f-b83c-476d-a092-66dd6fc91731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.729155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee09f-b83c-476d-a092-66dd6fc91731 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.735576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:50.739770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ee09f-b83c-476d-a092-66dd6fc91731 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.741595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ee09f-b83c-476d-a092-66dd6fc91731 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.743455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:50.744611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 228/458] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.750031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.755676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e4c2d-29ea-4db9-bc86-0b57994b8971 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.758641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-928ee09f-b83c-476d-a092-66dd6fc91731 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.759793 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 231/459] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.759995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.760543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.760887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.760980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60810d3-ac58-4834-ac3a-63e9df6ef618 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.761195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.761290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60810d3-ac58-4834-ac3a-63e9df6ef618 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.761478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60810d3-ac58-4834-ac3a-63e9df6ef618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.761964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.762302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.763566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:50.763566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:14:50.763566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:14:50.765050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.779170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b60810d3-ac58-4834-ac3a-63e9df6ef618 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:50.780360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b60810d3-ac58-4834-ac3a-63e9df6ef618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:50.789191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 229/460] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.789191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.789377 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 232/461] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:50.789449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60810d3-ac58-4834-ac3a-63e9df6ef618 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.794535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f8a32-9ae4-4fc4-9f28-d837c16777af admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.798616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60810d3-ac58-4834-ac3a-63e9df6ef618 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.800004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.800653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.801042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.801415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.802487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.802852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.804078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.804707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.804910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.805004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.805254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.806009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.806349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.807954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.816916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 233/462] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.819363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 230/463] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.822658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.822778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.832488 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b266d-c09b-45f2-861e-d586ecd7d65c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.832968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe988a-949f-4232-ba71-0cc52d39d726 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.836810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.837158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.837431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.837715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.837802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.837992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.838076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.838329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.838767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.839074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.839158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=a90779e40db745b3ba36fe213880bb4e) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.839454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.840666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.841268 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.848117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 231/464] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/role_assignments?user.id=a90779e40db745b3ba36fe213880bb4e&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.848868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.852776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 234/465] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.853622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.864103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3689d-1c69-46fd-bfca-480cf7e5c596 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.868779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.869624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.869739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c188706-c391-47bf-876f-61e9ab344ba1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.870201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.870201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.874999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.876044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.876473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.876926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.883388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.885308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.889356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.891332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.904206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.905684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 235/466] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.906286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.912901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:50.919554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 232/467] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.919554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.922467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4324-1ee5-4db5-86ea-3f6dceba024f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.926169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f737ea-652f-451a-b493-90a8f0cf62e1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.927112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.927923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.928156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.928425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.929285 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=3cb1d1929f8b40efa72d290b23c8f1e4) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.929609 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.930639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.931440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.931539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.931734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.931992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.937792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 236/468] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/role_assignments?user.id=3cb1d1929f8b40efa72d290b23c8f1e4&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.939133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.951324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc6067-0bd6-4372-9a30-1ad8a201bad4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.951969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.954548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.957270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.958078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.958507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.958859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:50.959763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:50.960150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:50.962058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:50.973473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:50.975534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 233/469] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:50.976877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.983101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 237/470] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:50.984205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:50.991002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ce53c-7835-4238-b7b3-d5c25310d13f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.995801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c1b05-a6e8-4a84-97b4-f9f50a4c8f05 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:50.996665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:50.997792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:50.998386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:50.998847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.000049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:51.000580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.000957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.001943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.002767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.002896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.003761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:51.004156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.004599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.005368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:14:51.005368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:14:51.005368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:14:51.006696 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.020251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 234/471] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:51.021498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.028837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 238/472] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:51.036475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.037233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbeb28-0cd6-4595-a4b6-6a50f3a87062 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.042639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.043659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.044604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.044945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.048504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18876b4d-4b7c-4b47-a149-631e5fced187 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.054510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.055600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.055930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.056310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.056815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.057770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.058241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.060482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.075648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 11 16:14:51.076922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 235/473] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:51.079112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.093328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897835-a956-4446-a706-b3880c65f55e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.099132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.099801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.100086 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.100367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.101229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=0d63f82b065248d68fe044e9de8b7b42) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:51.101541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.103480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.109622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 236/474] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/role_assignments?user.id=0d63f82b065248d68fe044e9de8b7b42&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:51.110490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.126590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44557ab-64b9-4aba-9d9a-432b5201af54 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.132524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.133615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.134237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.134848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.136048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:51.136582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.139224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.169456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 237/475] 10.222.0.11 () {56 vars in 1160 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:51.169456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.169856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 239/476] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:14:51 2021] POST /identity/v3/users => generated 247 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:14:51.179446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2e05-f269-4b91-8681-3eb4c3d260f2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.184590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.185305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.185594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.185874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.196161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.198083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.209323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 238/477] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:14:51.216009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.227233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056f83-52d1-4e5c-a486-39049f48a383 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.232094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.232909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.233251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.233577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.246615 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.248540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.271072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:51.272695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 240/478] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:51.279178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.289870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dbe21-a6ba-4d3e-8b31-f018f3dde9c5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.294877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.295603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.295951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.296235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.297054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:51.297372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.299822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.313947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 239/479] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:51.320310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.331716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc10d0-32cb-4023-aaa4-2f124c115529 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.336565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.337415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.337701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.337973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.346620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.348756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.364420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:51.364910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 241/480] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:51.371160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.386004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8154f-b738-4af1-9e15-aa9a39c7b238 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.393698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2e854-0ac5-4088-b1fe-1a78041d4954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.394797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e854-0ac5-4088-b1fe-1a78041d4954 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.395343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e854-0ac5-4088-b1fe-1a78041d4954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.395841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e854-0ac5-4088-b1fe-1a78041d4954 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.396931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e854-0ac5-4088-b1fe-1a78041d4954 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:51.397448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e854-0ac5-4088-b1fe-1a78041d4954 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.399694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e854-0ac5-4088-b1fe-1a78041d4954 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.415980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 240/481] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:51.422345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:51.434230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab735a79-95aa-437d-bf53-57176b7e4a0d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:51.443155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0906a07-5053-4c96-ab79-5ac8f6029dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:51.444157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0906a07-5053-4c96-ab79-5ac8f6029dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:51.444635 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0906a07-5053-4c96-ab79-5ac8f6029dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:51.445126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0906a07-5053-4c96-ab79-5ac8f6029dd9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:51.446211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0906a07-5053-4c96-ab79-5ac8f6029dd9 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=25123d6cb4fc417899321ecdb3c76b3e) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:51.446721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0906a07-5053-4c96-ab79-5ac8f6029dd9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:51.448755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0906a07-5053-4c96-ab79-5ac8f6029dd9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:51.458082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 242/482] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:51 2021] GET /identity/v3/role_assignments?user.id=25123d6cb4fc417899321ecdb3c76b3e&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:53.656917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86607-934b-431b-979c-c861fd5c7224 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.658639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86607-934b-431b-979c-c861fd5c7224 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.659244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86607-934b-431b-979c-c861fd5c7224 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.661790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 241/483] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:53.668716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2b540-48d1-4620-8d48-2c91f47719a6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.669252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2b540-48d1-4620-8d48-2c91f47719a6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.669252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2b540-48d1-4620-8d48-2c91f47719a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.699229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6dd2b540-48d1-4620-8d48-2c91f47719a6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:53.700448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6dd2b540-48d1-4620-8d48-2c91f47719a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:53.709604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 243/484] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:53.737196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86607-934b-431b-979c-c861fd5c7224 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:53.752751 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86607-934b-431b-979c-c861fd5c7224 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:53.762804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dbdd7-a8f6-4d89-9fa2-7933790f2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:53.763618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dbdd7-a8f6-4d89-9fa2-7933790f2e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.763903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dbdd7-a8f6-4d89-9fa2-7933790f2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.764184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dbdd7-a8f6-4d89-9fa2-7933790f2e77 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.783268 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3dbdd7-a8f6-4d89-9fa2-7933790f2e77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:53.791170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-af3dbdd7-a8f6-4d89-9fa2-7933790f2e77 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:53.797412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 242/485] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:53.798787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2b540-48d1-4620-8d48-2c91f47719a6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:53.812411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2b540-48d1-4620-8d48-2c91f47719a6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:53.818682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e473-0c99-4e99-b966-451d63c684a8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.818924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e473-0c99-4e99-b966-451d63c684a8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.819303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e473-0c99-4e99-b966-451d63c684a8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.821496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 243/486] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:53.823249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:53.823924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.824208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.824486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.825261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:53.825580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:53.827246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164a0e-1fb2-4730-90ac-57d6894163e0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.827467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:53.827566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164a0e-1fb2-4730-90ac-57d6894163e0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.827797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9164a0e-1fb2-4730-90ac-57d6894163e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.837179 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 244/487] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:53.844825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:53.862205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d9164a0e-1fb2-4730-90ac-57d6894163e0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:53.863409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d9164a0e-1fb2-4730-90ac-57d6894163e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:53.867249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9fbe8-2bae-48be-b543-b5c9d7aa7096 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:53.875422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:53.876209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.876687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.877460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.879866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 244/488] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:53.903328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:53.905195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:53.929351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:53.933993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 245/489] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:53.935347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9164a0e-1fb2-4730-90ac-57d6894163e0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:53.939201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:53.948770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9164a0e-1fb2-4730-90ac-57d6894163e0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:53.950594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476d3a-168d-46c2-84a2-1595cc297b47 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:53.954743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e87950-d7cb-4dc9-b96c-3af4e3554a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:53.955769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c5f9b-0ba7-47c7-ac08-db95f5e0f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:53.956009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e87950-d7cb-4dc9-b96c-3af4e3554a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.956304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e87950-d7cb-4dc9-b96c-3af4e3554a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.956583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e87950-d7cb-4dc9-b96c-3af4e3554a56 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.957266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5f9b-0ba7-47c7-ac08-db95f5e0f5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.957549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5f9b-0ba7-47c7-ac08-db95f5e0f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.957821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c5f9b-0ba7-47c7-ac08-db95f5e0f5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.958607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c5f9b-0ba7-47c7-ac08-db95f5e0f5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:53.958910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c5f9b-0ba7-47c7-ac08-db95f5e0f5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:53.960503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c5f9b-0ba7-47c7-ac08-db95f5e0f5e1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:53.968491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e87950-d7cb-4dc9-b96c-3af4e3554a56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:53.973451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 246/490] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:53.974743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb734-1d27-4454-bafa-5dcd2e16a91c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.975022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb734-1d27-4454-bafa-5dcd2e16a91c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.975293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb734-1d27-4454-bafa-5dcd2e16a91c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:53.976895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 247/491] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:53.978738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-64e87950-d7cb-4dc9-b96c-3af4e3554a56 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:53.980172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 245/492] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:53.985233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb734-1d27-4454-bafa-5dcd2e16a91c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:53.987363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f08c7-fca3-47ad-95d8-cfe4b2242565 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:53.987917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f08c7-fca3-47ad-95d8-cfe4b2242565 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:53.988394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f08c7-fca3-47ad-95d8-cfe4b2242565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.003547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb734-1d27-4454-bafa-5dcd2e16a91c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.011113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.011905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.012453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.012729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.014540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-786f08c7-fca3-47ad-95d8-cfe4b2242565 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:54.016676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-786f08c7-fca3-47ad-95d8-cfe4b2242565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:54.021231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.023699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.028071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 246/493] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:54.029338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f08c7-fca3-47ad-95d8-cfe4b2242565 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.046239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:14:54.046239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 248/494] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:53 2021] GET /identity/v3/users/cinder => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.047613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.050138 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f08c7-fca3-47ad-95d8-cfe4b2242565 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.056142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.057581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.058076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.058602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.059614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.059726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c266b-8a06-44e3-8d50-90c183db47bc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.060228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.062413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.065559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.066875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.067238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.067629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.068591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.069018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.072057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.074579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 247/495] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.080938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.093576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fd79-336b-475a-9900-adbab6f605ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.099269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.100151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.100388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 249/496] 10.222.0.11 () {56 vars in 1158 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.101520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.105380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.105713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.113418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6002080-f88f-406f-b43c-7ccb72409e1d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.117327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:54.118579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.119643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.120122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.120642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.124401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:54.125908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 248/497] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.126754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.133363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.135578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.138375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e827e6-ffbf-4f45-9001-fba59d6fb6e8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.143248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.144089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.144371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.144644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.155955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.156367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:54.163516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.163650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 250/498] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.163650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.175709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696dde8-d638-4734-9eb4-cf670c45f2b8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.180408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.181205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.181632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.182047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.182625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:54.183149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.183608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.184544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 249/499] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.185694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.190419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.195392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 251/500] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.196381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.200534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b1f77-c4a8-4505-ae86-1b20a5e4ad53 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.205965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95ab1a-e0c9-4380-a907-4cb3b63bcd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.206675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95ab1a-e0c9-4380-a907-4cb3b63bcd31 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.206963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95ab1a-e0c9-4380-a907-4cb3b63bcd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.207135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa57-aa6e-4a15-a55b-578c80c33926 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.207232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95ab1a-e0c9-4380-a907-4cb3b63bcd31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.207972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95ab1a-e0c9-4380-a907-4cb3b63bcd31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.208278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95ab1a-e0c9-4380-a907-4cb3b63bcd31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.209881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95ab1a-e0c9-4380-a907-4cb3b63bcd31 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.211814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.212942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.213231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.213511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.214285 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.214606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.216185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.226946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 250/501] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.226946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbbe02-d139-4047-83a9-82729f778e97 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.226946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbbe02-d139-4047-83a9-82729f778e97 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.226946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbbe02-d139-4047-83a9-82729f778e97 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.226946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 251/502] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:54.231501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbbe02-d139-4047-83a9-82729f778e97 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.232357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 252/503] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.238468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.243811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbbe02-d139-4047-83a9-82729f778e97 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.247892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb356d-b296-46ac-a2de-51dbe4c009cb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.248227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.248994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.249307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.249546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.253246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514b04-afa9-43c4-bf7b-d0d29a533888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.261400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514b04-afa9-43c4-bf7b-d0d29a533888 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.261400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514b04-afa9-43c4-bf7b-d0d29a533888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.261400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514b04-afa9-43c4-bf7b-d0d29a533888 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.261636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.261843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0514b04-afa9-43c4-bf7b-d0d29a533888 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.262405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.264120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0514b04-afa9-43c4-bf7b-d0d29a533888 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.277857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e0514b04-afa9-43c4-bf7b-d0d29a533888 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:14:54.278948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:54.279337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 253/504] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.280399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533ac4-813d-408e-826f-913cbcc12553 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.280685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533ac4-813d-408e-826f-913cbcc12553 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.280962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01533ac4-813d-408e-826f-913cbcc12553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.287201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 252/505] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.287201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.294387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518bbc5-0dac-40b6-8964-e43c75d87d55 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.300016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.300016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.300016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.300016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.304346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-01533ac4-813d-408e-826f-913cbcc12553 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:54.305617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-01533ac4-813d-408e-826f-913cbcc12553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:54.306824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.308765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.322209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 254/506] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:54.322209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533ac4-813d-408e-826f-913cbcc12553 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.331349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:54.332882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01533ac4-813d-408e-826f-913cbcc12553 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.338369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 253/507] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.339353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.339947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.340780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.341163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.341657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.342829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.343289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.345509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.350403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34de5-b2fd-4bab-971c-31b692e1e161 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.354969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.355648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.355928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.356204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.356963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.357265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.358910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.366691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 255/508] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.377063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 254/509] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.377241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.377335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.386568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e7d4-3bc0-4149-90b4-64544d175b82 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.387371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2f1cc-dc6b-4548-89e4-50c9e1f2c72a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.391381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.391650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.392446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.392548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.392791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.392898 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.393075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.393169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.393878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.394216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.396062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.407010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:54.407984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 256/510] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.413799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.414218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:54.420422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 255/511] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.420422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.427161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dbeec-5434-40ae-9873-050760b88a5c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.427887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363a396-57c3-4f22-8e25-83ccad6a81e5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.431534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.432297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.432421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.432579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.432854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.433267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.433561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.433836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.440736 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.442813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.446392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.448221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.456656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 11 16:14:54.457845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 256/512] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.463112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.465492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:54.466815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 257/513] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.470240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.473035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467e470-cd44-4e82-98a8-d4d5c2b22b67 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.477971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99964265-85f6-4ce6-803b-c311233b5a58 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.478199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.479077 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.479358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.479635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/a90779e40db745b3ba36fe213880bb4e/roles/2e5ce871831445568e7ab966da0a0812` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.482301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.482933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.483215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.483525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.484252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.484559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.486816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.494780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=a90779e40db745b3ba36fe213880bb4e, role_id=2e5ce871831445568e7ab966da0a0812)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.495576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 258/514] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.496353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.497412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.507383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9bc73-4da2-4ec0-857e-4fd8dca39e47 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.511736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.512620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.512903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.513177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.514016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.516489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.516489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.533014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 259/515] 10.222.0.11 () {56 vars in 1158 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.533927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.543110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23320d-d549-4d8b-86e6-7cb9427bfe92 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.547441 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb796d-75d4-417e-93ca-1ef3c667922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.548654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb796d-75d4-417e-93ca-1ef3c667922a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.548985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb796d-75d4-417e-93ca-1ef3c667922a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.549268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb796d-75d4-417e-93ca-1ef3c667922a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.550002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb796d-75d4-417e-93ca-1ef3c667922a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.550400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb796d-75d4-417e-93ca-1ef3c667922a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.551939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb796d-75d4-417e-93ca-1ef3c667922a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.563078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 260/516] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.565042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f9afd-7693-4a23-9621-cd6fd36bf045 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.565332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f9afd-7693-4a23-9621-cd6fd36bf045 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.565607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f9afd-7693-4a23-9621-cd6fd36bf045 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.568381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 261/517] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:54.568381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f9afd-7693-4a23-9621-cd6fd36bf045 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.574339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 257/518] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:54 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/a90779e40db745b3ba36fe213880bb4e/roles/2e5ce871831445568e7ab966da0a0812 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:54.575253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.642171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d403591-a7f9-4397-83be-8aa8eaa8b5d4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.644552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f9afd-7693-4a23-9621-cd6fd36bf045 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.648274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.649105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.649386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.649608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73ae2-321d-483f-a576-3a7165b4aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.649713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.650641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73ae2-321d-483f-a576-3a7165b4aa8b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.651079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73ae2-321d-483f-a576-3a7165b4aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.651503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73ae2-321d-483f-a576-3a7165b4aa8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.662875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.663427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73ae2-321d-483f-a576-3a7165b4aa8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.664765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.665008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73ae2-321d-483f-a576-3a7165b4aa8b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.683796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-afe73ae2-321d-483f-a576-3a7165b4aa8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:54.684426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:54.685061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 258/519] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.685492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 262/520] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.690320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4ef4-691f-4bb1-80ca-d935f70a4616 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.690320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4ef4-691f-4bb1-80ca-d935f70a4616 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.690320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4ef4-691f-4bb1-80ca-d935f70a4616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.692301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.704031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ccbe-7351-4423-84da-1fd8efb7b2d3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.709592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.710536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.710879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.711225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.712043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-27fd4ef4-691f-4bb1-80ca-d935f70a4616 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:54.713422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-27fd4ef4-691f-4bb1-80ca-d935f70a4616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:54.718856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.722333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.722486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 263/521] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:54.727316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4ef4-691f-4bb1-80ca-d935f70a4616 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.738434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:54.739594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4ef4-691f-4bb1-80ca-d935f70a4616 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.744709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.745824 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.746341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 259/522] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.746506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.746942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.747292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.748256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.748854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.750692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.758444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251745-2a1a-4064-98c1-9819013c501c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.763231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.763901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.764184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.764462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.765219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.765524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.766370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 264/523] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.767636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.773002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.778697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f123c6-71c0-458a-a805-47bacc55291b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.784118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.784951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.785378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.785812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.786648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.787277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.788587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 260/524] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.789375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.789808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.802865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038156b-ea43-408e-b363-a9c7d9a023b8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.803257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 265/525] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.806204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.810539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.811344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.811626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.811901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.814839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ff84d-65e8-45af-a4a5-8d9bdc0c8824 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.819429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.820207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.820551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.820878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.823450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:54.827982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.830330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.830710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:54.832138 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 261/526] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.832796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.843449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:54.844780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 266/527] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.846336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.848548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4e793-c221-4f3c-b7bd-b7cc84e08cf3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.853135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.853900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.854196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.854469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.856347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e610fd-9d2d-4ef1-af64-2e069b6c5214 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.861642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.862516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.862712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.862811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.863057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/3cb1d1929f8b40efa72d290b23c8f1e4/roles/2e5ce871831445568e7ab966da0a0812` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.864708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.877156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=3cb1d1929f8b40efa72d290b23c8f1e4, role_id=2e5ce871831445568e7ab966da0a0812)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.877943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 11 16:14:54.879317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 262/528] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:54.879827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.884922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.894672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff55b0-f660-4a0f-905f-e474a02d8fe7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.898944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.899564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.899842 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.900110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.900859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.901157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.902756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.912044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 263/529] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.912640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.925829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249d43b-b1ff-433b-a897-12444b2023ea admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:54.930103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:54.930749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:54.931028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:54.931301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:54.932083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:54.932402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:54.934218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:54.940082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 267/530] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:54 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/3cb1d1929f8b40efa72d290b23c8f1e4/roles/2e5ce871831445568e7ab966da0a0812 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:54.940737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.957150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 264/531] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:54.957150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:54.973375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5f95-cd6d-44f8-b456-dd46329b3a75 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.027022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f1395-c270-4609-95ad-7d3e65dc6d3e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.032322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.033635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.033916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.034204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.035058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.036019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.036736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.037294 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.038463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.039203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.041622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.045471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.047177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.063528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 268/532] 10.222.0.11 () {56 vars in 1160 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:55.064749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.067199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:55.068709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 265/533] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:55.069500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.076669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbe03f-bfe2-4e20-97ca-9d045afbd89a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.082677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.083921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.084449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.084980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/0d63f82b065248d68fe044e9de8b7b42/roles/2e5ce871831445568e7ab966da0a0812` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.085584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafae5-4c7f-4ac7-965c-cbe6bc2ae0dd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.090731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.091274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.091605 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.091875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.104025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.104514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=0d63f82b065248d68fe044e9de8b7b42, role_id=2e5ce871831445568e7ab966da0a0812)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.105876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.107938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.124822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:55.126386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 266/534] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:55.126966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.144520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a743868-ea3d-4161-a19a-7dfd6f508608 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.148803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.149465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.149745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.150017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.150812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.153541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.153541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.165871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 267/535] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:55.166709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.176130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84dea-c11f-499b-b7f6-ab3877d7485e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.178719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 269/536] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:55 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/0d63f82b065248d68fe044e9de8b7b42/roles/2e5ce871831445568e7ab966da0a0812 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:14:55.179665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.247339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.248020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.248299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.248569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.249321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.249624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.252266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.265562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 268/537] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:55.271726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae9e27-8895-4c70-b4c9-bd7202defe18 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.272271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.276445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.277578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.277867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.278147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.282548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0301-ec30-43ba-a410-f1a690df3ea3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.287483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.287626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.288281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.288562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.288896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.289693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.296481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.299184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.306023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:14:55.307641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 270/538] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:55.314528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.314758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:55.316262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 269/539] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:55.322652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.324811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5289-7060-4f38-b68c-491dd31e81cf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.330504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.331467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.331752 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.332031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.333067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.333261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27f43-65c0-401b-97c0-c5b39e02c223 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.333416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.335258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.338468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.339332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.339855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.340263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.341179 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.341847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.343955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.354732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 271/540] 10.222.0.11 () {56 vars in 1156 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:55.361635 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.362893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 270/541] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:55.369433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.377138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d54d67-1f6d-45e8-bff2-c4787c45c952 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.380049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa0a3d-295c-4a3d-8bee-4b159bd0f0b4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.384672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.385570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.385850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.386121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/25123d6cb4fc417899321ecdb3c76b3e/roles/2e5ce871831445568e7ab966da0a0812` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.391242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.391951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.392240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.392520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.411071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.417022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.420701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=25123d6cb4fc417899321ecdb3c76b3e, role_id=2e5ce871831445568e7ab966da0a0812)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.424056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.436837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 272/542] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:55.443887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.453705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434cdb6-161f-4f9e-8641-32059b693a5b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.458636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.459490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.459771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.460141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.473742 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.475792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.494242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:55.495744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 273/543] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:55.504234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.514535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0a03a-51af-40ea-b0cb-d6635d38b5bf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.522553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 271/544] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:55 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/25123d6cb4fc417899321ecdb3c76b3e/roles/2e5ce871831445568e7ab966da0a0812 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:14:55.580236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.580817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.581150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.581425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.582189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.582502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.584207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.597639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 274/545] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:55.604029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.627718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe5ebe-a9f0-4dce-9097-c4ad06c18938 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.638085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.638948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.639234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.639507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.649430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.651419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.668501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:55.669705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 272/546] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:55.677586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.691870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b320-ed23-4b20-8cc0-3f1686a7b9c7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.697512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cf0c2-1275-41ae-b9cb-a2a02e9d539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.698524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf0c2-1275-41ae-b9cb-a2a02e9d539e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.699020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf0c2-1275-41ae-b9cb-a2a02e9d539e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.699505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf0c2-1275-41ae-b9cb-a2a02e9d539e admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.700593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf0c2-1275-41ae-b9cb-a2a02e9d539e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.701108 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf0c2-1275-41ae-b9cb-a2a02e9d539e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.703311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf0c2-1275-41ae-b9cb-a2a02e9d539e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.722810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 275/547] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:55.729877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:55.744969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b162601-3468-473c-8dc4-526bd021e895 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:55.754547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e45dde-257d-43a0-b10e-ba22407a4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:55.755207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e45dde-257d-43a0-b10e-ba22407a4027 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:55.755494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e45dde-257d-43a0-b10e-ba22407a4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:55.755784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e45dde-257d-43a0-b10e-ba22407a4027 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:55.756635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e45dde-257d-43a0-b10e-ba22407a4027 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=43db7d84ce72442cbccd9ee65c70551b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:55.756946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e45dde-257d-43a0-b10e-ba22407a4027 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:55.758824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e45dde-257d-43a0-b10e-ba22407a4027 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:55.765244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 273/548] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:55 2021] GET /identity/v3/role_assignments?user.id=43db7d84ce72442cbccd9ee65c70551b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.040280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b6a2c-ced3-4d0a-ade7-374feab4e3b0 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.040792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b6a2c-ced3-4d0a-ade7-374feab4e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.040866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b6a2c-ced3-4d0a-ade7-374feab4e3b0 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.042886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 276/549] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:57.049071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264a87-2c24-4fff-8110-c3e7dde17e4b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.049493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264a87-2c24-4fff-8110-c3e7dde17e4b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.049676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de264a87-2c24-4fff-8110-c3e7dde17e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.074015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-de264a87-2c24-4fff-8110-c3e7dde17e4b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:57.075244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de264a87-2c24-4fff-8110-c3e7dde17e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:57.086267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 274/550] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:57.128226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b6a2c-ced3-4d0a-ade7-374feab4e3b0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.140901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b6a2c-ced3-4d0a-ade7-374feab4e3b0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.150203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.150987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.151268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.151545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.168163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:57.175392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:57.176988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 277/551] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:57.183161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264a87-2c24-4fff-8110-c3e7dde17e4b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.193098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de264a87-2c24-4fff-8110-c3e7dde17e4b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.202377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.203132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.203489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.203864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.205050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:57.205440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.207130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.222742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 275/552] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.228926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.239129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f60a-3a2f-4eee-9633-d8351d5a6ba3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.246347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.247213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.247568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.247914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.263794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.265736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.287276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:57.288869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 278/553] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:57.295282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.312869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0062b8a-dd08-4420-bd73-e8dc52b3b706 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.326911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.327714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.328076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.328431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.329828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:57.330235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.331900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.347613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 276/554] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.353810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.367402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b9f17-152c-4ffa-9939-7aebba1ef1c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.375831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.376670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.376983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.377255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.389658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.392496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.414552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:14:57.416008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 279/555] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:57.422521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.441208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842c15c-757a-41ef-ae21-34b7e58b9640 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.450348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.451103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.451460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.451811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.452750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:57.453130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.455749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.485890 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 277/556] 10.222.0.11 () {56 vars in 1158 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.492304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.507740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d23f7-a914-4601-a0be-4571560b0b68 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.515682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.517336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.517796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.518274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.530597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.533461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.548221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 280/557] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:57.554350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.571112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139ad7d-7266-42d9-a900-3889b3278d3d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.579954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.580957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.581416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.581891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.602804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.605011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.633059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:57.634627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 278/558] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:57.641026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.659152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95851c-deaa-4aab-b2c8-65aa0218dbed admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.667331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93391a-c63d-4bf5-b3f3-dcb48fbcd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.668005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93391a-c63d-4bf5-b3f3-dcb48fbcd774 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.668292 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93391a-c63d-4bf5-b3f3-dcb48fbcd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.668569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93391a-c63d-4bf5-b3f3-dcb48fbcd774 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.669316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93391a-c63d-4bf5-b3f3-dcb48fbcd774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:57.669624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93391a-c63d-4bf5-b3f3-dcb48fbcd774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.671250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93391a-c63d-4bf5-b3f3-dcb48fbcd774 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.684326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 281/559] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.691127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.708168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b75a33-07bc-4a81-b4ad-816881f51d97 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.715474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.716583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.717130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.717655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.731727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.734354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.749726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2d23-128a-46bd-9c06-6fba41aaa3ef None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.750015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2d23-128a-46bd-9c06-6fba41aaa3ef None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.750320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2d23-128a-46bd-9c06-6fba41aaa3ef None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.752874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 282/560] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:57.753287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:57.755071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 279/561] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:57.758155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca8b7-de28-4dac-b909-a9e2173e6829 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.758489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca8b7-de28-4dac-b909-a9e2173e6829 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.758762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca8b7-de28-4dac-b909-a9e2173e6829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.765254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.787275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b3d98-5782-496c-a8c0-6d54eed93848 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.796445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.797097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.797382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.798300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.799267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:57.799584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.801422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.803978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e3dca8b7-de28-4dac-b909-a9e2173e6829 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:57.805201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e3dca8b7-de28-4dac-b909-a9e2173e6829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:57.822226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 283/562] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:14:57.824455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 280/563] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.831259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca8b7-de28-4dac-b909-a9e2173e6829 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.847996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca8b7-de28-4dac-b909-a9e2173e6829 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.856574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.857266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.857542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.857870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.858840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=a90779e40db745b3ba36fe213880bb4e) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:57.859148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.862028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.871611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.874956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 284/564] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/role_assignments?user.id=a90779e40db745b3ba36fe213880bb4e&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.888123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5d6fa-3a93-4925-b6f2-7cc4af8dcb53 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.905123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.905954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.906273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.906548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.928699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:57.935915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:57.937548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 281/565] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:57.944795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:57.960068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f443a-1464-42a6-a984-bd4949309841 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:57.970010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:57.971198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:57.971608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:57.971979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:57.972914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:57.973336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:57.975144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:57.991046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 285/566] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:57.997438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.012981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94919a-8646-42da-96b9-2552901e6367 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.022719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.023534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.023820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.024099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.043233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.045201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.069972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:58.071607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 282/567] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.077506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.095011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bebe0-6d77-415c-85df-5d69f784e8c4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.103209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.103936 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.104217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.104492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.105344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.105652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.107341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.122703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 286/568] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.128754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.138913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befbf75-1c6d-4269-8edc-5c468e75d5f0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.144307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b27a21-59eb-4095-b86d-abaf909163b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.145095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b27a21-59eb-4095-b86d-abaf909163b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.145383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b27a21-59eb-4095-b86d-abaf909163b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.145658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b27a21-59eb-4095-b86d-abaf909163b3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.153620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b27a21-59eb-4095-b86d-abaf909163b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.155771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b27a21-59eb-4095-b86d-abaf909163b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.171239 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a5b27a21-59eb-4095-b86d-abaf909163b3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:14:58.172999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 283/569] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.178977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.190167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0bf09-c4a6-457e-86e5-117b8e3ca529 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.196955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.197935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.198449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.198914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.200003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.200583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.202718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.220222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4017b9-4ff6-42be-97b9-1e6f0743582d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.220523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4017b9-4ff6-42be-97b9-1e6f0743582d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.220783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4017b9-4ff6-42be-97b9-1e6f0743582d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.223013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 284/570] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:58.223865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 287/571] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.229267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dee5b-db76-43e4-8086-3d5cef1c32a8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.230336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.230679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dee5b-db76-43e4-8086-3d5cef1c32a8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.231122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dee5b-db76-43e4-8086-3d5cef1c32a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.243263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cdb91-c486-4d22-a9b2-1b68ed9d8d6d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.248191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.248949 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.249320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.249720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.253918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8f2dee5b-db76-43e4-8086-3d5cef1c32a8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:58.255434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8f2dee5b-db76-43e4-8086-3d5cef1c32a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:58.261605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.267708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.268978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 285/572] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:58.278201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 288/573] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:58.281389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dee5b-db76-43e4-8086-3d5cef1c32a8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.293117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dee5b-db76-43e4-8086-3d5cef1c32a8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.296213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.299543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.300567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.301001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.301678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.306919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b94c-a454-4492-a68b-124d8953f7e1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.311080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.311964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.312343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.312711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.316470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.318591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.324944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:58.333090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:58.334836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 289/574] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:58.338368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:58.339960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 286/575] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.343241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.347413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.356235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9ba91-a679-4dbe-937b-5a37817efac9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.359199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b13ac-56a9-4c89-9679-b2228fbd95f7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.361590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.362433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.362812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.363245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.364322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.364724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.365094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.365902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.366383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.366802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.366911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.367776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.368245 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.370824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.377933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 290/576] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.384495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 287/577] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:58.384637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.390743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.401588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e19c-35f0-4314-8abb-f39f0554c3e2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.402764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09c2d7-91b5-431c-acff-1c493ec5d566 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.407483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.408191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.408671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.409099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.409488 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.409685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.410135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.410611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.426677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.428926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.431143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.433570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.459234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:58.461046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 291/578] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.463839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:58.463839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 288/579] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:58.470540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.471563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.488948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d841-e5a9-46ec-a0f5-a153bef19526 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.491390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae281d8-544f-44ca-947c-3e46da3534b0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.499737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.501148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.502313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.503214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.503662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.504089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.504521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.505517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.505956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.506876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.507331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.509349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.509831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.512001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.531580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 289/580] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.543473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 292/581] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.543610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.549412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.553430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1ff0f-d499-4bf7-b607-d7f758beb3e9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.558496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.559519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.560005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.560507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.561584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=3cb1d1929f8b40efa72d290b23c8f1e4) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.562141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.564846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.572109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 290/582] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/role_assignments?user.id=3cb1d1929f8b40efa72d290b23c8f1e4&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:58.580744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb729-3845-4ede-a929-c8d1a92419a1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.603344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61189f-b028-4882-a208-12bd24041b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.604163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61189f-b028-4882-a208-12bd24041b7c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.604442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61189f-b028-4882-a208-12bd24041b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.604710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61189f-b028-4882-a208-12bd24041b7c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.623671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61189f-b028-4882-a208-12bd24041b7c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.625760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61189f-b028-4882-a208-12bd24041b7c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.650040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1b61189f-b028-4882-a208-12bd24041b7c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 11 16:14:58.651582 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 293/583] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/users/glance => generated 84 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.658357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.671599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09fd30-552e-4089-a150-dfda617c0716 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.681589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc84a0-48c7-42f6-809d-de1ba28ae52f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.681918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc84a0-48c7-42f6-809d-de1ba28ae52f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.682138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc84a0-48c7-42f6-809d-de1ba28ae52f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.683668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d83be-38d4-4e0f-8d39-223c9db3001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.684266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 294/584] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:14:58.684852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d83be-38d4-4e0f-8d39-223c9db3001f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.685331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d83be-38d4-4e0f-8d39-223c9db3001f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.685802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d83be-38d4-4e0f-8d39-223c9db3001f admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.686932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d83be-38d4-4e0f-8d39-223c9db3001f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.687535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d83be-38d4-4e0f-8d39-223c9db3001f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.689840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d83be-38d4-4e0f-8d39-223c9db3001f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.699559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be7f57-9247-4751-b3c3-9472dbe5aa16 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.704835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be7f57-9247-4751-b3c3-9472dbe5aa16 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.705444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be7f57-9247-4751-b3c3-9472dbe5aa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.733367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 291/585] 10.222.0.11 () {56 vars in 1158 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:58.733367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613263-9f0d-479e-86f1-41b724f18d12 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.733367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613263-9f0d-479e-86f1-41b724f18d12 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.733367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613263-9f0d-479e-86f1-41b724f18d12 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.733367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 292/586] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:14:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:14:58.738861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e4be7f57-9247-4751-b3c3-9472dbe5aa16 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:58.740119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472ded-2551-413a-b486-1c4c60c4dfa7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.740413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472ded-2551-413a-b486-1c4c60c4dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.740697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472ded-2551-413a-b486-1c4c60c4dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.741095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e4be7f57-9247-4751-b3c3-9472dbe5aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:58.754305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 295/587] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:58.755596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be7f57-9247-4751-b3c3-9472dbe5aa16 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.762628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6d472ded-2551-413a-b486-1c4c60c4dfa7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:14:58.763848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6d472ded-2551-413a-b486-1c4c60c4dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:14:58.772650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be7f57-9247-4751-b3c3-9472dbe5aa16 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.774065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 293/588] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:14:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:14:58.788080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.789101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.789611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.790086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.801956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472ded-2551-413a-b486-1c4c60c4dfa7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.805201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.807256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.812349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472ded-2551-413a-b486-1c4c60c4dfa7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.817466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 296/589] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:58.818269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.818856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.819128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.819411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.822228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.835805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89010f-b01e-4aa8-8588-dc793fa80f70 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.840619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:58.842001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.843022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.843451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.843850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.849823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:58.851300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 294/590] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.852198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.863557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:14:58.867917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c3da5-b357-4bf8-8eb2-90feac86c5e0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.870804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:14:58.872218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 297/591] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.872816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.873330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.874113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.874453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.874739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.883945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b3597-c2a9-4817-88d3-35150e51ede8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.886654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.888585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.889674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.890343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.890673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.890890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.892209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.892497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.894066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.902965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 298/592] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.903754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.908072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:58.909433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 295/593] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.914281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbdd64-6dc6-45ef-9db6-71a1583a312d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.915240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.918822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.919463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.919743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.920014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.920769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.921110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.923923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.931219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024c9f-8d01-40ed-8ff5-d6df95b3aae7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.932657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 299/594] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.933466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.936043 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.936827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.937112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.937388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.943572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c2d3-5b86-4749-bb57-2f0782283051 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.948263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.948916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.949193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.949467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.950237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:58.950549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.951069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.952135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.953063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:58.964735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 300/595] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:58.965551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.972438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:58.974327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 296/596] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:58.975191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d979e2-2193-4610-a04b-ad5634099698 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.976713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:58.979713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.980460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.980744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.981011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.987938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124fd0-0b5c-450d-a240-c1c2b5003067 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:58.992872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:58.993679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:58.993969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:58.994296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:58.995733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:58.998038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.001975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.004030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.017825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:59.019142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:59.020008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 301/597] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:59.020582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 297/598] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:59.021235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.025964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.035028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186ca0f-565d-4afa-a19e-98db21689558 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.036160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e7ae8-698d-4332-a1de-7779665e9804 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.040409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.040724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.041366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.041654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.041938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.042247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.042729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.042836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.043043 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.043510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.044586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.044690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.045188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.047106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.057072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 298/599] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.057943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.061440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 302/600] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.067898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66bfb4-d0d6-4040-b707-304acb280c59 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.071124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.075756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.076962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.077395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.077853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.079479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.079880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.081884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.082414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d38fe2-8a38-4be1-98a2-c15ad8cab74a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.087597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.088545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.088987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.089403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.096398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 299/601] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.102571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.106207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.108238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.110837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3360c-99f1-4fb2-ad2b-8e8d26765d1e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.115267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.116050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.116333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.116602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.124195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.126526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.127171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 11 16:14:59.129545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 303/602] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:59.130522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.144412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed29fa8-8c8a-4093-b511-a747eddda5d9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.146829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:14:59.150257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 300/603] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:59.151233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.154360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.155009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.155292 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.155570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.156422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=0d63f82b065248d68fe044e9de8b7b42) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.157353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.159255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.166229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 304/604] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/role_assignments?user.id=0d63f82b065248d68fe044e9de8b7b42&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.167031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.169889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d9e1a-2e62-443e-8b4e-a8fc80386973 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.181538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.183746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.184249 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.184902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.187159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.187737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.189603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d635-d65e-41c7-8e33-0ff290e4766c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.191805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.211529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.212213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.212495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.212767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.213624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.213956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.215847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.221771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 301/605] 10.222.0.11 () {56 vars in 1160 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.223481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.233528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8aa4-5137-45a4-a1e0-e7b5d6a394d7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.238689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.239754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.240251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.240725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.251927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.257206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.257639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 305/606] 10.222.0.11 () {56 vars in 1156 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.272770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.282205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 302/607] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:14:59.285159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671e24b-1a7f-425c-b06d-1c0796507b88 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.290578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.291697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.292205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.292675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.296313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.305631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.307842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.311303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738afc5-3a22-46e8-a45e-7c185e75274b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.330971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.331782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.332063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.332338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.336267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:59.338000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 306/608] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:59.344167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.358709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.361103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.364350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda31f7f-0cf3-4abb-afc7-66ce6b23ddd0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.374808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.376639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.377646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.378155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.380626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.381205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.384538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.404549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:14:59.409326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 303/609] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:14:59.409957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 307/610] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.419063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.421816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.433488 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2fff-616b-4d4b-9b51-20a230efa192 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.433664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f387a3-14e7-43aa-a6f7-0715aa6aa2cc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.438728 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.439241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.439753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.440104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.440389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.440669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.441969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.442286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.443056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.443370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.444999 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.448908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.450888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.458280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 308/611] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:59.464310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.467211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:59.469372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 304/612] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:59.478331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.479497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5ede3-4499-48ed-a2ed-5b391982afc9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.484925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.485724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.486009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.486313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.489711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d31c8c-a92d-4af7-8bf3-84e540b2e369 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.493847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.495862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.496290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.497001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.497287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.497612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.499017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.499333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.502037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.514082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:14:59.515716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 305/613] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.518349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 309/614] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:14:59.524305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.528260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.540189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178b888-8214-408f-8339-c887b247d55b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.546310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1ac83-06e6-4ded-9c92-75a6997573b8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.549209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.549775 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fe0b5-4904-4a4d-9488-d78046e73635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.549932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.550247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.550535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.551383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe0b5-4904-4a4d-9488-d78046e73635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.551489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.551705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.552120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe0b5-4904-4a4d-9488-d78046e73635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.552568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe0b5-4904-4a4d-9488-d78046e73635 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/43db7d84ce72442cbccd9ee65c70551b/roles/2e5ce871831445568e7ab966da0a0812` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.553792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.570445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 306/615] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:14:59.575705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fe0b5-4904-4a4d-9488-d78046e73635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=43db7d84ce72442cbccd9ee65c70551b, role_id=2e5ce871831445568e7ab966da0a0812)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.577396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:14:59.579166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fe0b5-4904-4a4d-9488-d78046e73635 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.588248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa699-bc2a-406a-86e6-4d1fb7bd05bd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:14:59.592689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70c4c-c5e4-4d8f-a9b6-6c93d5a1408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:14:59.593416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70c4c-c5e4-4d8f-a9b6-6c93d5a1408d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:14:59.593776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70c4c-c5e4-4d8f-a9b6-6c93d5a1408d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:14:59.595252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70c4c-c5e4-4d8f-a9b6-6c93d5a1408d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:14:59.595252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70c4c-c5e4-4d8f-a9b6-6c93d5a1408d admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=25123d6cb4fc417899321ecdb3c76b3e) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:14:59.595417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70c4c-c5e4-4d8f-a9b6-6c93d5a1408d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:14:59.598397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70c4c-c5e4-4d8f-a9b6-6c93d5a1408d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:14:59.605614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 307/616] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:14:59 2021] GET /identity/v3/role_assignments?user.id=25123d6cb4fc417899321ecdb3c76b3e&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:14:59.666349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 310/617] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:14:59 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/43db7d84ce72442cbccd9ee65c70551b/roles/2e5ce871831445568e7ab966da0a0812 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:15:00.661558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973a1a-4167-4952-bf3e-ac0ea72e1222 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:00.662109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973a1a-4167-4952-bf3e-ac0ea72e1222 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:00.662109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973a1a-4167-4952-bf3e-ac0ea72e1222 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:00.664184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 308/618] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:00.669935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79e9fe-5586-4f65-b9d0-deb4d4909566 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:00.670333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79e9fe-5586-4f65-b9d0-deb4d4909566 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:00.670528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79e9fe-5586-4f65-b9d0-deb4d4909566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:00.695127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6b79e9fe-5586-4f65-b9d0-deb4d4909566 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:00.696304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6b79e9fe-5586-4f65-b9d0-deb4d4909566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:00.774362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 311/619] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:15:00.819844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c973a1a-4167-4952-bf3e-ac0ea72e1222 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:00.836078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c973a1a-4167-4952-bf3e-ac0ea72e1222 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:00.846841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:00.847660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:00.847940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:00.848211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:00.848883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:00.849881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:00.849881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:15:00.849881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:15:00.850777 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:00.865318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 11 16:15:00.866676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 309/620] 10.222.0.11 () {56 vars in 1150 bytes} [Thu Nov 11 16:15:00 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:00.875269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79e9fe-5586-4f65-b9d0-deb4d4909566 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:00.884620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79e9fe-5586-4f65-b9d0-deb4d4909566 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:00.894512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:00.895197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:00.895528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:00.895798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:00.896596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:00.896904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:00.897913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:00.897913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:15:00.897913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:15:00.898808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d551d3-d2fe-4be2-900e-f3e1e5c04cc1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:00.910951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 312/621] 10.222.0.11 () {56 vars in 1145 bytes} [Thu Nov 11 16:15:00 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:00.917085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:00.927701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc91b70-eb40-49bb-8ec5-9dc8427a0399 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:00.933235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:00.933982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:00.934297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:00.934570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:00.935304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:00.935655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:00.936651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:00.936651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:15:00.936651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:15:00.937900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc6ea9-8961-473f-99f0-f510637b787c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:00.947099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 310/622] 10.222.0.11 () {56 vars in 1145 bytes} [Thu Nov 11 16:15:00 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:01.219529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf624-e59b-44b1-90a5-ab50da3c6333 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.219914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf624-e59b-44b1-90a5-ab50da3c6333 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.220088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf624-e59b-44b1-90a5-ab50da3c6333 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.222094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 313/623] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:01.228848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb13-6b1a-4288-9707-4ed77a3152ef None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.228848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb13-6b1a-4288-9707-4ed77a3152ef None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.228848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb13-6b1a-4288-9707-4ed77a3152ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.250718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f045eb13-6b1a-4288-9707-4ed77a3152ef None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:01.252272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f045eb13-6b1a-4288-9707-4ed77a3152ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:01.266807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 311/624] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:15:01.311638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf624-e59b-44b1-90a5-ab50da3c6333 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.326881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf624-e59b-44b1-90a5-ab50da3c6333 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.335112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.335925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.336205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.336476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.353222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:01.361110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:01.362719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 314/625] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:01.369652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045eb13-6b1a-4288-9707-4ed77a3152ef None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.386211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045eb13-6b1a-4288-9707-4ed77a3152ef None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.392094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.393037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.393528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.394028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.395047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:01.395559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.397362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.411117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 312/626] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:01.417243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.434568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da8411-9f0c-4ffd-b089-ab916bfc1636 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.440756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.441598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.441880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.442161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.459659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.461508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.484656 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:01.486014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 315/627] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:01.492037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.508244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27a68-22a5-47c9-b148-482e58e9a544 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.513365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.518531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.519244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.519734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.520886 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:01.521430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.523336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.545412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 313/628] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:01.550625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.572564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87900b8-0d86-42d5-92b9-434f1f0900fa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.584285 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.585077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.585354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.585622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.599373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.601356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.621839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:15:01.623691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 316/629] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:01.630310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.644258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a41d-4de0-4af4-9cb1-6a29cf047f94 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.657124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.657923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.658346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.658748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.659694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:01.660110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.662049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.684503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 314/630] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:01.690918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.706137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f2ae-f625-4695-8a5d-af5aabb8eb65 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.713137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.713960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.714451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.714869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.729744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.731748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.748204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 317/631] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:15:01.754481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.768384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b130f6-cefa-44d9-b4e4-302d87e74323 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.772962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.773865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.778574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.778973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.795392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.797969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.823002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:01.824417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 315/632] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:01.830760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.842977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6342-305c-4720-a67c-d856d54d9d35 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.856145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.857041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.857578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.858124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.859077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:01.860112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.861905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.883225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 318/633] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:01.889501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.899625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e229892-4801-4b5e-8c9c-3a12b51bb066 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.909867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.910685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.910972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.911249 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.918400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.920382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:01.942156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:01.943387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 316/634] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:01.949654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:01.967551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2e62a-c4a0-42ed-9a22-f52bacd8bd00 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:01.975725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c558-5fb5-44c7-ba9a-78a7ecc7987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:01.976726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c558-5fb5-44c7-ba9a-78a7ecc7987c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:01.977228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c558-5fb5-44c7-ba9a-78a7ecc7987c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:01.977757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c558-5fb5-44c7-ba9a-78a7ecc7987c admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:01.978799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080c558-5fb5-44c7-ba9a-78a7ecc7987c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:01.979342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080c558-5fb5-44c7-ba9a-78a7ecc7987c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:01.981441 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080c558-5fb5-44c7-ba9a-78a7ecc7987c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.004688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 319/635] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:02.010693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.024313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f628e-e7d1-4878-a7b1-0728a8362be3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.038801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffa666-8789-4d67-a98e-d2d9fd52060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.039456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffa666-8789-4d67-a98e-d2d9fd52060c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.039741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffa666-8789-4d67-a98e-d2d9fd52060c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.040019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffa666-8789-4d67-a98e-d2d9fd52060c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.040874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffa666-8789-4d67-a98e-d2d9fd52060c admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=3cb1d1929f8b40efa72d290b23c8f1e4) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:02.041181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffa666-8789-4d67-a98e-d2d9fd52060c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:02.043060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffa666-8789-4d67-a98e-d2d9fd52060c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.049584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 317/636] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:02 2021] GET /identity/v3/role_assignments?user.id=3cb1d1929f8b40efa72d290b23c8f1e4&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:02.276005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7e3cd-c709-485b-b6be-9ebffc4737d3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.276686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7e3cd-c709-485b-b6be-9ebffc4737d3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.277176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7e3cd-c709-485b-b6be-9ebffc4737d3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.279707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 320/637] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:02.286495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c709ca-e2a3-42cc-a648-1a41e5098e29 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.286823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c709ca-e2a3-42cc-a648-1a41e5098e29 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.287072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c709ca-e2a3-42cc-a648-1a41e5098e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.320807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d0c709ca-e2a3-42cc-a648-1a41e5098e29 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:02.322035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d0c709ca-e2a3-42cc-a648-1a41e5098e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:02.334352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 318/638] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:15:02.366219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7e3cd-c709-485b-b6be-9ebffc4737d3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.380155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7e3cd-c709-485b-b6be-9ebffc4737d3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.384489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.385264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.385589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.386127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.397917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:02.399817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.424372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:02.425600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 321/639] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:02.431978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c709ca-e2a3-42cc-a648-1a41e5098e29 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.447253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c709ca-e2a3-42cc-a648-1a41e5098e29 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.455119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4501d-cb3f-4007-b41d-2ffa4b8baf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.455791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4501d-cb3f-4007-b41d-2ffa4b8baf8c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.456076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4501d-cb3f-4007-b41d-2ffa4b8baf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.456356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4501d-cb3f-4007-b41d-2ffa4b8baf8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.457120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4501d-cb3f-4007-b41d-2ffa4b8baf8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:02.457432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4501d-cb3f-4007-b41d-2ffa4b8baf8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:02.459097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4501d-cb3f-4007-b41d-2ffa4b8baf8c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.484902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 319/640] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:02.490653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.504043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56ca88-da9a-49ef-9449-c8d0779207e3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.514917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae5a82-3ab3-42d0-8731-f42784bd6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.515659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5a82-3ab3-42d0-8731-f42784bd6e90 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.515971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5a82-3ab3-42d0-8731-f42784bd6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.516195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5a82-3ab3-42d0-8731-f42784bd6e90 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.516940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae5a82-3ab3-42d0-8731-f42784bd6e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:02.518891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae5a82-3ab3-42d0-8731-f42784bd6e90 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.631015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 322/641] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:15:02 2021] POST /identity/v3/users => generated 254 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:02.733331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f011a-9f86-46ee-9d1c-1f32cea23fe1 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.733850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f011a-9f86-46ee-9d1c-1f32cea23fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.733923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f011a-9f86-46ee-9d1c-1f32cea23fe1 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.736694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 320/642] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:02.747791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c837-1f5a-416f-aeb3-eb3d92e5f406 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.748300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c837-1f5a-416f-aeb3-eb3d92e5f406 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.748373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c837-1f5a-416f-aeb3-eb3d92e5f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.783017 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-af48c837-1f5a-416f-aeb3-eb3d92e5f406 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:02.784270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-af48c837-1f5a-416f-aeb3-eb3d92e5f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:02.792476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 323/643] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:15:02.827831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f011a-9f86-46ee-9d1c-1f32cea23fe1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.844947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f011a-9f86-46ee-9d1c-1f32cea23fe1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.854973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.855798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.856085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.856368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] PATH_INFO: `/v3/services/network` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.857188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:02.858885 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.871477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 11 16:15:02.872704 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 321/644] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:02 2021] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:02.881086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e98c7-daf3-4490-bff7-f6a67e26adaf None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.881381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e98c7-daf3-4490-bff7-f6a67e26adaf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.881659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e98c7-daf3-4490-bff7-f6a67e26adaf None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.883593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 324/645] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:02.884413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.892067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03259c-8783-423e-b672-73729a7ffc05 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.892648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03259c-8783-423e-b672-73729a7ffc05 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.893121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03259c-8783-423e-b672-73729a7ffc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.908272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f2112-7d28-4ca9-9386-c3e5189334bb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.917497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.918615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.920678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.921172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.924117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:02.924680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:02.925412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1f03259c-8783-423e-b672-73729a7ffc05 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:02.927342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.928279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1f03259c-8783-423e-b672-73729a7ffc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:02.933377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 322/646] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:02 2021] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:02.939730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.942798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 325/647] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:15:02.954616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f3f3-2784-41ac-a1f3-9dd89eac7f1a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.961175 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.962115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.962650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.963169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:02.964108 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] RBAC: Adding query filter params (type=network) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:02.964654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:02.966554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:02.973720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03259c-8783-423e-b672-73729a7ffc05 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:02.974397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 323/648] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:02 2021] GET /identity/v3/services?type=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:02.991138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03259c-8783-423e-b672-73729a7ffc05 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:02.996631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:02.997821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:02.998470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:02.998953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.014097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:03.022477 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:15:03.024387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 326/649] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:15:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:03.031882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.042794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303cb30-4f2b-4865-8bac-880b2147f3df admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.048872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.049997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.050519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.051060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.052160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:03.052676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.054597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.065511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 324/650] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:03.072417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.084096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafe73a-155d-40cc-bec0-70cfc4f68237 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.089351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.090501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.091220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.092362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.108219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.112576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.133300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:03.135355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 327/651] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:03.142512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.153334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f395dcb-67c2-44b2-85b7-b171fa4d482f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.159832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.160902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.161455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.161958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.163018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:03.163602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.165555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.180601 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 325/652] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:03.187241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.199197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a1c83-2fb3-43e3-84b5-3b8560ecf460 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.205206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.206327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.206830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.207388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.216470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.219548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.234132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:15:03.236222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 328/653] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:03.243254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.256022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c2dbe-e907-455c-a812-adcdba967f7b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.262720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.263397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.263750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.264037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.264903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:03.265220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.267482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.290873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 326/654] 10.222.0.11 () {56 vars in 1156 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:03.296926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.306735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710478c-4555-45a8-96a5-68055651fee8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.318455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.319103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.319382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.319654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.338002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.339771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.356206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 329/655] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:15:03.363342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.378000 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c738734-b7fc-43a6-8d61-e4e0fb882b82 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.384354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.385288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.386006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.386409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.401978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.404010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.431283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:03.432669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 327/656] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:03.439480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.460918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c666f-9aec-4b3d-8707-94dd46fb1915 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.475814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.476495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.476774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.477046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.477790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:03.478093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.479721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.503536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 330/657] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:03.509613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.524158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a2b4b-d01e-43a1-b59f-6eccc4b155f2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.532767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.533719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.534162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.534571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.542500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.544623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.559138 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:03.560726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 328/658] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:03.566807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.584015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf4a1-bb94-45aa-b06e-003695c4dd59 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.594232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3c64b-356a-4c7e-b94f-446a0b5f0415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.594884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c64b-356a-4c7e-b94f-446a0b5f0415 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.595161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c64b-356a-4c7e-b94f-446a0b5f0415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.595429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3c64b-356a-4c7e-b94f-446a0b5f0415 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.596229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c64b-356a-4c7e-b94f-446a0b5f0415 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:03.596530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c64b-356a-4c7e-b94f-446a0b5f0415 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.598390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3c64b-356a-4c7e-b94f-446a0b5f0415 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.619380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 331/659] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:03.625990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.639544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a15301-0dad-41cb-8011-122f1a61db5e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:03.650586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4857b8d-9753-4e9a-bedb-fbb5716a1c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:03.651301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4857b8d-9753-4e9a-bedb-fbb5716a1c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.651588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4857b8d-9753-4e9a-bedb-fbb5716a1c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.651870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4857b8d-9753-4e9a-bedb-fbb5716a1c50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.652777 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4857b8d-9753-4e9a-bedb-fbb5716a1c50 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=43db7d84ce72442cbccd9ee65c70551b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:03.653096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4857b8d-9753-4e9a-bedb-fbb5716a1c50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:03.655084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4857b8d-9753-4e9a-bedb-fbb5716a1c50 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:03.667136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 329/660] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:03 2021] GET /identity/v3/role_assignments?user.id=43db7d84ce72442cbccd9ee65c70551b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:03.898145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4656e-b7b7-4f4a-85da-6b5b74d72c92 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.898827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4656e-b7b7-4f4a-85da-6b5b74d72c92 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.898827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4656e-b7b7-4f4a-85da-6b5b74d72c92 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.900711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 332/661] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:03.907314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901733a8-4b18-4b38-9b82-ebd81a9436b3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:03.907878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901733a8-4b18-4b38-9b82-ebd81a9436b3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:03.907878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901733a8-4b18-4b38-9b82-ebd81a9436b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:03.935315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-901733a8-4b18-4b38-9b82-ebd81a9436b3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:03.936555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-901733a8-4b18-4b38-9b82-ebd81a9436b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:03.944996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 330/662] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:15:03.969682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4656e-b7b7-4f4a-85da-6b5b74d72c92 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:03.989045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4656e-b7b7-4f4a-85da-6b5b74d72c92 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:04.000638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262653a-5f5a-42e2-9062-a5907bcb10d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:04.001539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262653a-5f5a-42e2-9062-a5907bcb10d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.001717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262653a-5f5a-42e2-9062-a5907bcb10d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.001884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262653a-5f5a-42e2-9062-a5907bcb10d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.002638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262653a-5f5a-42e2-9062-a5907bcb10d3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:04.005295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-2262653a-5f5a-42e2-9062-a5907bcb10d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:04.005295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:15:04.005295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:15:04.005295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262653a-5f5a-42e2-9062-a5907bcb10d3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:04.133635 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 333/663] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:03 2021] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:04.628270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b77f-2cf2-45b8-b548-f1db3a9ce7e7 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.628618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b77f-2cf2-45b8-b548-f1db3a9ce7e7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.628839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b77f-2cf2-45b8-b548-f1db3a9ce7e7 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.630669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 331/664] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:04.636926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad6b7-add7-43bd-82c8-92766878e714 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.637223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad6b7-add7-43bd-82c8-92766878e714 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.637484 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ad6b7-add7-43bd-82c8-92766878e714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.659232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0b0ad6b7-add7-43bd-82c8-92766878e714 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:04.660418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0b0ad6b7-add7-43bd-82c8-92766878e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:04.683063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 334/665] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:04 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:04.711143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b77f-2cf2-45b8-b548-f1db3a9ce7e7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:04.726466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b77f-2cf2-45b8-b548-f1db3a9ce7e7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:04.737294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:04.738027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.738336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.738609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.755113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:04.762280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:04.763683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 332/666] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:04.770808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ad6b7-add7-43bd-82c8-92766878e714 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:04.784705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ad6b7-add7-43bd-82c8-92766878e714 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:04.789421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:04.790031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.790340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.790616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.791394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:04.791701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:04.793310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:04.805723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 335/667] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:04.813333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:04.827156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e669d9c-93f3-41c5-a6c7-00e162939d30 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:04.836739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:04.837533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.837817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.838096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.853771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:04.855678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:04.876338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:04.878294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 333/668] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:04.884122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:04.899275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191291d6-62d1-4592-a902-fa091c273f6d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:04.906892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:04.907565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.907850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.908129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.908880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:04.909191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:04.910839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:04.925204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 336/669] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:04.931377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:04.947299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c1842-7aad-4e67-854a-a8a9dfb8a016 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:04.955732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:04.956519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:04.956802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:04.957079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:04.970987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:04.972999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:04.990132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:15:04.991522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 334/670] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:15:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:04.997682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.011380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abc90c-5565-4bd8-bd29-7073b417f075 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.019743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.020408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.020690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.020966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.021818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:05.022125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.024003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:05.050470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 337/671] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:15:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:05.056377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.071164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7d16e-e1c1-40bb-a208-5c92a1984d64 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.079720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.080515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.080795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.081072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.098544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.100374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:05.120311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:05.121539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 335/672] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:05.127838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.139312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed505577-405b-4a3c-8781-53a218dd36ff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.148218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.148881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.149162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.149433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.150202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:05.150497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.152110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:05.165661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 338/673] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:05.171865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.187883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ee36-7c5b-487d-a01a-d1a610946bc3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.198480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.199280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.199564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.199843 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.219886 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.221860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:05.240440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:05.246282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 336/674] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:05.248229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.261253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57054bb-4acd-4a5c-9239-334111238820 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.271736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5675f5-a037-4aa1-a5ba-924ee99e26a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.272932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5675f5-a037-4aa1-a5ba-924ee99e26a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.273429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5675f5-a037-4aa1-a5ba-924ee99e26a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.273959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5675f5-a037-4aa1-a5ba-924ee99e26a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.275060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5675f5-a037-4aa1-a5ba-924ee99e26a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:05.275633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5675f5-a037-4aa1-a5ba-924ee99e26a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.277764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5675f5-a037-4aa1-a5ba-924ee99e26a8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:05.303996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 339/675] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:05.310456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.327601 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400845f-d937-4a52-863a-47bde7c8f4af admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.344100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1b19a-9ec4-41a7-b403-ecb1dc2b4db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.344982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b19a-9ec4-41a7-b403-ecb1dc2b4db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.345267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b19a-9ec4-41a7-b403-ecb1dc2b4db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.345544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b19a-9ec4-41a7-b403-ecb1dc2b4db9 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/3cb1d1929f8b40efa72d290b23c8f1e4/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.351527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1b19a-9ec4-41a7-b403-ecb1dc2b4db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=3cb1d1929f8b40efa72d290b23c8f1e4, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.354169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1b19a-9ec4-41a7-b403-ecb1dc2b4db9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:05.447197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 337/676] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:15:05 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/3cb1d1929f8b40efa72d290b23c8f1e4/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:15:05.731516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c278a-0946-47a7-a03c-b09aa0cec58f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.732218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c278a-0946-47a7-a03c-b09aa0cec58f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.732712 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c278a-0946-47a7-a03c-b09aa0cec58f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.735549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 340/677] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:05.742569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba1a3-9b72-4505-8bd2-5a2d802c3c5f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.742861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba1a3-9b72-4505-8bd2-5a2d802c3c5f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.743146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba1a3-9b72-4505-8bd2-5a2d802c3c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.767157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-153ba1a3-9b72-4505-8bd2-5a2d802c3c5f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:05.768356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-153ba1a3-9b72-4505-8bd2-5a2d802c3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:05.835924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 338/678] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:05 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:05.859576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f8ae-28e8-459a-b5a5-0976fe968e1c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.859916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f8ae-28e8-459a-b5a5-0976fe968e1c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.860193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f8ae-28e8-459a-b5a5-0976fe968e1c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.863442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 341/679] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:05.868491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161ceae-12a5-4afb-ae9e-5242e66311ad None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.868793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161ceae-12a5-4afb-ae9e-5242e66311ad None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.869079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161ceae-12a5-4afb-ae9e-5242e66311ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.875426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872f8ae-28e8-459a-b5a5-0976fe968e1c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.890775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2161ceae-12a5-4afb-ae9e-5242e66311ad None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:05.893467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2161ceae-12a5-4afb-ae9e-5242e66311ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:05.898849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872f8ae-28e8-459a-b5a5-0976fe968e1c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.907864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.908577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.908867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.909145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.910706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 339/680] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:05 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:05.910817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.912222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:05.937587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161ceae-12a5-4afb-ae9e-5242e66311ad None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.946909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161ceae-12a5-4afb-ae9e-5242e66311ad None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.951722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.955288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.955288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.955288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.964252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:05.971990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:15:05.973597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 340/681] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:15:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:05.979825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:05.990082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89003f31-25da-464f-a8d3-bda3b9a61c43 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:05.994909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:05.995631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:05.995917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:05.996196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:05.997028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:05.997335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:05.999109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.010167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 341/682] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:15:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:06.017492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.025585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 342/683] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:05 2021] POST /identity/v3/services => generated 240 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:06.036905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e5756-0ac4-4eda-9bb2-15c8b5e80fbc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.071279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.072477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.072960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.073425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.089487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.091652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.114074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:06.116873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 342/684] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:06.122406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.137090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839196e7-57cf-4163-b3da-d8472bf5e35b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.142132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.142969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.143413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.143853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.144737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:06.145195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.147014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.165726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 343/685] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:06.172684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.187767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88782d43-734b-43dc-a833-4f935e0abe11 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.195954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.197008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.197432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.197877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.207409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.209644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.229753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:15:06.231181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 343/686] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:06.238153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.251533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982cff-1cf2-4065-b416-70d25279262b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.258931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.272820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.272820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.272820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.272820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:06.272820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.272820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.285676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 344/687] 10.222.0.11 () {56 vars in 1170 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:06.292007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.307561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5471f-6307-44d5-a513-30e4ce2149f5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.315494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.316387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.316815 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.317261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.330866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.332882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.348492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 344/688] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:06.354790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.373486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0dba9-7505-4a30-84ee-5a78944335f4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.383763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.384859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.385562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.385981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.402675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.404618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.430624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:06.432160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 345/689] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:06.438123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.447469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c915e-5d15-4f2e-8568-27270f08f235 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.452252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.453479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.453948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.454264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.455069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:06.455378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.457024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.469935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 345/690] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:06.475818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.486640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1b1fe-759e-4a94-87d4-9ea481ab11c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.491442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.492276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.492560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.492835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.500719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.502860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.517553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:06.519088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 346/691] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:06.525015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.543576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea2fee-004a-470a-9c4a-0d272111f71f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.558939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0122f2-0416-4d48-98fa-a207e71e97f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.559634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0122f2-0416-4d48-98fa-a207e71e97f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.559915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0122f2-0416-4d48-98fa-a207e71e97f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.560188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0122f2-0416-4d48-98fa-a207e71e97f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.561006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0122f2-0416-4d48-98fa-a207e71e97f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:06.561313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0122f2-0416-4d48-98fa-a207e71e97f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.563262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0122f2-0416-4d48-98fa-a207e71e97f7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.579725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 346/692] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:06.586224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.598362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44009f9-16dd-4cec-97e3-538b1cb76984 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.608010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e8bf9-2846-42e5-80fe-fb6e0560f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.609357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8bf9-2846-42e5-80fe-fb6e0560f73d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.609653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8bf9-2846-42e5-80fe-fb6e0560f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.609931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e8bf9-2846-42e5-80fe-fb6e0560f73d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.610926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e8bf9-2846-42e5-80fe-fb6e0560f73d admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=9f7408badb7143c097d6450cb1e2ec8b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:06.611294 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e8bf9-2846-42e5-80fe-fb6e0560f73d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.613205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e8bf9-2846-42e5-80fe-fb6e0560f73d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.619719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 347/693] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/role_assignments?user.id=9f7408badb7143c097d6450cb1e2ec8b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:06.813302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcaf1-db09-4342-bfc1-0d56bdba7a17 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.813484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcaf1-db09-4342-bfc1-0d56bdba7a17 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.813869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbcaf1-db09-4342-bfc1-0d56bdba7a17 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.815964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 347/694] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:06.822067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46df7c-4243-43c7-b3ed-b742f07f32a7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.822384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46df7c-4243-43c7-b3ed-b742f07f32a7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.822659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46df7c-4243-43c7-b3ed-b742f07f32a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.845580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-be46df7c-4243-43c7-b3ed-b742f07f32a7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:06.846800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-be46df7c-4243-43c7-b3ed-b742f07f32a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:06.861093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 348/695] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:06.887411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbcaf1-db09-4342-bfc1-0d56bdba7a17 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.900371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbcaf1-db09-4342-bfc1-0d56bdba7a17 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.904715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.905488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.906318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.906585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.917305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:06.924546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:06.926066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 348/696] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:06.932430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46df7c-4243-43c7-b3ed-b742f07f32a7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.942302 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46df7c-4243-43c7-b3ed-b742f07f32a7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.946734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.947383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.947665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.947938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:06.948698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:06.949002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:06.950619 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:06.959404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 349/697] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:06.965468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:06.980446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27a82a-2525-45f7-9553-bff6076357a1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:06.985523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:06.986420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:06.986703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:06.986977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.002291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.004200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.024520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:07.025727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 349/698] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:07.032697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.044492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a01c-52bb-4031-8c1a-010e4a115141 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.050260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.050907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.051278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.051580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.052278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.052679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.054357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.071501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 350/699] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:07.078473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.091982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75d3de-0a40-4f43-96f3-41e8ac2ab28b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.102084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.102947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.103227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.103547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.123827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.126813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.146313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:15:07.147906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 350/700] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/users/swift => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:07.154335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.165063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08a03e-3f6a-4f41-a6ec-deb7f60f01c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.169695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.170434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.170719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.170995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.172710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.173073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.174991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.199054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 351/701] 10.222.0.11 () {56 vars in 1156 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:07.206030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.216833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eca43-02db-4b32-b914-1b0ff5c5130c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.226025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc360-94bf-4617-a100-d4baaad07dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.226785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc360-94bf-4617-a100-d4baaad07dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.227089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc360-94bf-4617-a100-d4baaad07dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.227386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc360-94bf-4617-a100-d4baaad07dd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.241909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc360-94bf-4617-a100-d4baaad07dd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.243698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc360-94bf-4617-a100-d4baaad07dd8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.255687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 351/702] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:15:07.262467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.273009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f79c1-d36c-426e-ac28-896c035d31aa None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.273374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9ded4-e777-476f-bda4-d8e8cfc36889 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.273673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f79c1-d36c-426e-ac28-896c035d31aa None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.274235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f79c1-d36c-426e-ac28-896c035d31aa None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.276601 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 352/703] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:07.283047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.283360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79bc6-8236-4a94-93d2-b19f26c4aa92 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.283794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79bc6-8236-4a94-93d2-b19f26c4aa92 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.283907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.284158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.284506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.284666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc79bc6-8236-4a94-93d2-b19f26c4aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.295702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.298457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.322003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:07.323298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-efc79bc6-8236-4a94-93d2-b19f26c4aa92 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:07.323491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 352/704] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:07.324715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-efc79bc6-8236-4a94-93d2-b19f26c4aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:07.329700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.339987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bbe8d-d168-4b4e-a6c0-cf7ea59bc0c9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.340518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 353/705] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:07 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:07.344514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.345152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.345433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.345705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.346471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.346773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.348350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.360988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 353/706] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:07.367225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79bc6-8236-4a94-93d2-b19f26c4aa92 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.380505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc79bc6-8236-4a94-93d2-b19f26c4aa92 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.384538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.395972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8484-3de7-403d-9d9c-3ea5b6cbb014 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.397742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.400302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.400595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.400876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.405408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.407095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.408020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.408300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.408977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.412965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:07.412965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:15:07.412965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:15:07.413943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.415596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.420611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.443425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 11 16:15:07.448329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:07.449545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 354/707] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:07.449807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 354/708] 10.222.0.11 () {56 vars in 1150 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:07.455097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.464561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.476633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f752b70-cd32-4be6-99fe-f7719ce8b2e0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.479405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cd13-ffec-4a44-9e49-d81f0cbe3ab2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.486102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.488031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.488352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.488629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.490042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.490992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.491296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.491836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.492115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.492382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.494498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.494807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.495855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.498204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.507842 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 355/709] 10.222.0.11 () {56 vars in 1145 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:07.513290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 355/710] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:07.515012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.519980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.528323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740200f-1018-489d-9d02-fde5e5907576 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.534215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747327-28c8-4fab-bfed-347f56f08232 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.546204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.546204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.546204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.546204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.546633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.546633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.546633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.548246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.548246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.548453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.548654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.549568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=43db7d84ce72442cbccd9ee65c70551b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.549880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.553632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.558459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 356/711] 10.222.0.11 () {56 vars in 1145 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:07.563520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 356/712] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/role_assignments?user.id=43db7d84ce72442cbccd9ee65c70551b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:07.565086 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.581416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41dbe3-4be6-4c92-97ef-f43e45117ebf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.595740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.596432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.596723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.597013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.597853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] RBAC: Adding query filter params (interface=public, service_id=66bd2e42bce14273a3c6b05f4854bba1, region_id=RegionOne) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:07.598199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.599238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:07.599238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:15:07.599238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:15:07.600138 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5b35c-c674-4146-b689-9ceacf7a42e3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.613693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 357/713] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/endpoints?service_id=66bd2e42bce14273a3c6b05f4854bba1&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:07.620039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:07.636062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246235d-6bc1-4431-820c-383abe08e697 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:07.645926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef1fd1-e612-4a43-b239-2e3af9e29e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:07.646647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1fd1-e612-4a43-b239-2e3af9e29e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:07.646932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1fd1-e612-4a43-b239-2e3af9e29e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:07.647212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1fd1-e612-4a43-b239-2e3af9e29e04 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:07.647937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef1fd1-e612-4a43-b239-2e3af9e29e04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:07.649581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef1fd1-e612-4a43-b239-2e3af9e29e04 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:07.659884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 357/714] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:07 2021] GET /identity/v3/services => generated 772 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:08.354000 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0511cb-c966-431e-9ce3-c3c8638e8f06 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.354590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0511cb-c966-431e-9ce3-c3c8638e8f06 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.354669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0511cb-c966-431e-9ce3-c3c8638e8f06 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.356630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 358/715] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:08.363092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bac22-329e-4a16-8c47-247e1df88041 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.363618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bac22-329e-4a16-8c47-247e1df88041 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.363791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bac22-329e-4a16-8c47-247e1df88041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.398360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-711bac22-329e-4a16-8c47-247e1df88041 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:08.399563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-711bac22-329e-4a16-8c47-247e1df88041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:08.413864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 358/716] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:08.440478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0511cb-c966-431e-9ce3-c3c8638e8f06 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.457103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0511cb-c966-431e-9ce3-c3c8638e8f06 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.464607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.465391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.465673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.465952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.480565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:08.487678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:08.488897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 359/717] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:08.495394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bac22-329e-4a16-8c47-247e1df88041 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.511539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bac22-329e-4a16-8c47-247e1df88041 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.520175 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.520843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.521126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.521403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.522192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:08.522507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.524125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.543410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 359/718] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:08.548571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.563388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc561f-ca11-4301-a5f1-00a33ac242f6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.574392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.575186 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.575472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.575752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.593928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.595808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.622871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:08.624016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 360/719] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:08.630906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.647206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e43276-4e9d-40ef-a4b7-b95d78bed52a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.657226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.657884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.658170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.658470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.659219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:08.659532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.661135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.677305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 360/720] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:08.683398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.699912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a24479-99c6-4fa1-b513-9740aa0189f4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.709078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.709894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.710198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.710481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.723619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.725681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.745663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:15:08.747114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 361/721] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:08.753418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.767528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd95ca-379e-4529-8bd7-0606d24b5945 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.776129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4c2c8-cfc4-4323-90a8-aac7a933417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.776782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c2c8-cfc4-4323-90a8-aac7a933417c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.777061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c2c8-cfc4-4323-90a8-aac7a933417c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.777329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c2c8-cfc4-4323-90a8-aac7a933417c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.778192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4c2c8-cfc4-4323-90a8-aac7a933417c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:08.778509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4c2c8-cfc4-4323-90a8-aac7a933417c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.780920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4c2c8-cfc4-4323-90a8-aac7a933417c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.809807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 361/722] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:08.816409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.831310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd79a1-d2e1-4447-a5c6-1ad87b5277eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.839324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.839971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.840252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.840527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.856274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.856274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.867606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e414e4-c17e-4f31-9740-3b8ce2a49cd6 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.867891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e414e4-c17e-4f31-9740-3b8ce2a49cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.868166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e414e4-c17e-4f31-9740-3b8ce2a49cd6 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.870155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 362/723] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:08.871079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 362/724] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:08.877570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2205f2-caf8-4404-a018-6778e48765c1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.878085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2205f2-caf8-4404-a018-6778e48765c1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.878599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2205f2-caf8-4404-a018-6778e48765c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.880974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.901271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f4fff-7b51-429d-9cb9-12b9632781ad admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.906950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9b2205f2-caf8-4404-a018-6778e48765c1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:08.908671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9b2205f2-caf8-4404-a018-6778e48765c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:08.913208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.914357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.914843 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.915312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.930128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 363/725] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:08.932397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.934535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.953019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:08.954917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 363/726] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:08.958470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2205f2-caf8-4404-a018-6778e48765c1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.965982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:08.969342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2205f2-caf8-4404-a018-6778e48765c1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:08.979822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:08.980965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:08.981445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:08.981975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] PATH_INFO: `/v3/services/network` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:08.984073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:08.986145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:08.989171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705e23-4391-4a4e-babe-de159bca86a5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.000603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.001548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.003439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.003919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.004968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:09.006655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.009259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.013361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 11 16:15:09.016970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 364/727] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/services/network => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:09.025203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.036333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 364/728] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:09.039300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e55a-7719-4039-8ddf-78930d840aaa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.042782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.052791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.053797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.054306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.055312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.056425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:09.058657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.060505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badaf2f-05d4-4d0a-85a9-3bf76264f061 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.061971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.070581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.071693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.072720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 365/729] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:09.073330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.073827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.079346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.088636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.090948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.092691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e097b-9171-4ea1-88ba-72d487226060 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.101783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.102478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.102757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.103028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.103750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] RBAC: Adding query filter params (type=network) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:09.104053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.105638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.108085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:09.110636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 365/730] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:09.116319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.124531 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 366/731] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:09.127090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e75d-555c-44eb-877d-9304dcd80d5a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.131492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.132762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.133695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.134195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.134752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.136070 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:09.136578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.138849 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.151841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 366/732] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:09.152602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5800b4-72ec-41b1-9b6e-3b6c3c852bac admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.158649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.164047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.166308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.166796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.167336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.168507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] RBAC: Adding query filter params (interface=public, service_id=851ccd75296c4a1fb1e501f70ce277c8, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:09.169957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.172851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:09.172851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:15:09.172851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:15:09.175361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.176683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2516f4-4b6e-4542-af5f-54817c67a1fd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.186346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00bc0f-5646-462c-8341-6c94cd5c2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.188417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00bc0f-5646-462c-8341-6c94cd5c2a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.188958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00bc0f-5646-462c-8341-6c94cd5c2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.189472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00bc0f-5646-462c-8341-6c94cd5c2a73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.191317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00bc0f-5646-462c-8341-6c94cd5c2a73 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=3cb1d1929f8b40efa72d290b23c8f1e4) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:09.192517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00bc0f-5646-462c-8341-6c94cd5c2a73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.194766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 367/733] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/endpoints?service_id=851ccd75296c4a1fb1e501f70ce277c8&interface=public®ion_id=RegionOne => generated 194 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:09.196154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00bc0f-5646-462c-8341-6c94cd5c2a73 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.199574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.208816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 367/734] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/role_assignments?user.id=3cb1d1929f8b40efa72d290b23c8f1e4&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:09.218555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ad9d0-5f3c-4727-b54a-8518ce5677f1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.236136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780bfff-8d35-4905-8330-0dcf64674476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.236829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780bfff-8d35-4905-8330-0dcf64674476 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.237109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780bfff-8d35-4905-8330-0dcf64674476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.237379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780bfff-8d35-4905-8330-0dcf64674476 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.238094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780bfff-8d35-4905-8330-0dcf64674476 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.239788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780bfff-8d35-4905-8330-0dcf64674476 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.245929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 368/735] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/services => generated 772 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:09.776447 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414dbde-607f-4db8-8691-dc5a3757c2c3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.776952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414dbde-607f-4db8-8691-dc5a3757c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.777027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414dbde-607f-4db8-8691-dc5a3757c2c3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.779078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 368/736] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:09.786080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3da97b-04c8-4998-8e01-3904cd1f3144 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.786594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3da97b-04c8-4998-8e01-3904cd1f3144 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.786777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3da97b-04c8-4998-8e01-3904cd1f3144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.811160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ad3da97b-04c8-4998-8e01-3904cd1f3144 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:09.812414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad3da97b-04c8-4998-8e01-3904cd1f3144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:09.823521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 369/737] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:09 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:09.859900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414dbde-607f-4db8-8691-dc5a3757c2c3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.874304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414dbde-607f-4db8-8691-dc5a3757c2c3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.882135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.882937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.883217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.883490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.903071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:09.910649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:15:09.911870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 369/738] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:09.918257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3da97b-04c8-4998-8e01-3904cd1f3144 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.927962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3da97b-04c8-4998-8e01-3904cd1f3144 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.938896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.939557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.939836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.940106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:09.940874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:09.941177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:09.942804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:09.957960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 370/739] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:09.965411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:09.979061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de998e5-3e7a-449e-95d5-9df2013d785c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:09.984251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:09.985029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:09.985305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:09.985577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.000928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.002789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.022795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:10.023958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 370/740] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:10.030786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.043131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c603-2c66-4f3d-b7e7-9e303156e1a8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.051976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.052658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.052939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.053214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.053974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.054316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.055985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.071630 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 371/741] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:10.078768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.091638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b0adf-7691-400c-a9be-5e7455cde3cd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.098626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.099411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.099695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.099968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.114408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.116428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.136708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:15:10.137897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 371/742] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:10.144762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.159959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b8638-ce1e-40e9-bc0b-38ea76fd4cab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.167350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042c69-bab3-4051-8eda-6fed1d24fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.168300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042c69-bab3-4051-8eda-6fed1d24fc05 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.168780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042c69-bab3-4051-8eda-6fed1d24fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.169328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042c69-bab3-4051-8eda-6fed1d24fc05 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.170412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042c69-bab3-4051-8eda-6fed1d24fc05 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.171467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042c69-bab3-4051-8eda-6fed1d24fc05 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.173579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042c69-bab3-4051-8eda-6fed1d24fc05 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.200856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 372/743] 10.222.0.11 () {56 vars in 1170 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:10.207555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.220013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ef48-cbef-4937-b589-5280bc8d4995 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.230327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.231111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.231396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.231675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.248703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.250897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.280891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e1c6-c1c3-4d0d-b9d4-99089a45a94c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.281369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:10.281736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e1c6-c1c3-4d0d-b9d4-99089a45a94c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.282235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10e1c6-c1c3-4d0d-b9d4-99089a45a94c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.282890 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 372/744] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:10.284928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 373/745] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:10.288659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.291583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e74fe-20c4-4738-a027-e0536c987c41 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.292085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e74fe-20c4-4738-a027-e0536c987c41 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.292560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e74fe-20c4-4738-a027-e0536c987c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.299394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8e7a-348a-48e1-b0e5-b596164b4b86 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.311856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.312527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.312807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.313080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.313827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.314134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.315752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.328302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 373/746] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:10.329561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5e3e74fe-20c4-4738-a027-e0536c987c41 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:10.331681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5e3e74fe-20c4-4738-a027-e0536c987c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:10.334398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.347840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 374/747] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:10.357751 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e299172-2595-4e20-b65d-1d9cd12243a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.364358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.365450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.366029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.366547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.371657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e74fe-20c4-4738-a027-e0536c987c41 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.382058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e74fe-20c4-4738-a027-e0536c987c41 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.384023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.386685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.392792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.393579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.393856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.394127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.410947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:10.412374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 374/748] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:10.424038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:10.431015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:10.438977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.440116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 375/749] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:10.445262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.456717 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8bce3-55b2-4982-9311-def8c6f79d58 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.460969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e2e5-ad09-4d42-ac50-4333a83ac450 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.466371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.467046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.467324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.467635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.468797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.469104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.470997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.473323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.473990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.474291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.474563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.475331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.475633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.477213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.492540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 376/750] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:10.495801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 375/751] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:10.501391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.509321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.516672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8c5d-6505-4ec4-96d2-1ca24eb32bd4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.523197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.523980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.524256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.524528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.527438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b3501-626f-4369-b8f5-def6a343b629 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.538692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6971f-a523-4631-a319-ec3acdba3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.539590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6971f-a523-4631-a319-ec3acdba3de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.539872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6971f-a523-4631-a319-ec3acdba3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.540144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6971f-a523-4631-a319-ec3acdba3de3 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/9f7408badb7143c097d6450cb1e2ec8b/roles/2e5ce871831445568e7ab966da0a0812` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.544545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.548228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.571321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6971f-a523-4631-a319-ec3acdba3de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=9f7408badb7143c097d6450cb1e2ec8b, role_id=2e5ce871831445568e7ab966da0a0812)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.574031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6971f-a523-4631-a319-ec3acdba3de3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.575179 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:10.576700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 377/752] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:10.584911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.596215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2f6d-ccc7-416f-a6a0-2ea056dd6eb8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.601220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45805ef-eb6f-46f8-8645-eb7c6bd22f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.601919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45805ef-eb6f-46f8-8645-eb7c6bd22f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.602293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45805ef-eb6f-46f8-8645-eb7c6bd22f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.602571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45805ef-eb6f-46f8-8645-eb7c6bd22f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.603351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45805ef-eb6f-46f8-8645-eb7c6bd22f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.603708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45805ef-eb6f-46f8-8645-eb7c6bd22f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.605541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45805ef-eb6f-46f8-8645-eb7c6bd22f1e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.618167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 378/753] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:10.619390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809864f-2962-40c5-86ad-8f18f5d6a379 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.619705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809864f-2962-40c5-86ad-8f18f5d6a379 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.619988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809864f-2962-40c5-86ad-8f18f5d6a379 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.621895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 379/754] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:10.625993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809864f-2962-40c5-86ad-8f18f5d6a379 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.638353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809864f-2962-40c5-86ad-8f18f5d6a379 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.642830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.643590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.643871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.644138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.652146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.654172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.667851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:15:10.669148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 376/755] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:15:10 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/9f7408badb7143c097d6450cb1e2ec8b/roles/2e5ce871831445568e7ab966da0a0812 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:15:10.675286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 380/756] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:10.675538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6af89-1f60-413c-8105-777b152233a8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.675831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6af89-1f60-413c-8105-777b152233a8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.676113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6af89-1f60-413c-8105-777b152233a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.676376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.687115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aba234-cd7b-4223-a7ff-21f7ced34db8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.724208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-29e6af89-1f60-413c-8105-777b152233a8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:10.725427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-29e6af89-1f60-413c-8105-777b152233a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:10.782350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.783038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.783363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.783655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.784572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.784885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.789188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.833876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 381/757] 10.222.0.11 () {56 vars in 1156 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:10.842711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 377/758] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:10.843743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.853703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c09602-d779-4599-b740-7eb8b30856c2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.867982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.868782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.869063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.869340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.871036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6af89-1f60-413c-8105-777b152233a8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.883241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6af89-1f60-413c-8105-777b152233a8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.897062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.897884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.898162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.898463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.899145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.900757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.902302 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.904144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.922608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 11 16:15:10.924099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:10.925728 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 382/759] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:10.930624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 378/760] 10.222.0.11 () {56 vars in 1150 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:10.931929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.939045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.942431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c24cc-0e49-4d52-ab16-ed355613041b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.947114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.947801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.948069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.948340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.949108 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.949409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.951105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.953014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9793a-eff8-4749-a0dc-47b9f028219f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.965829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 383/761] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:10.971735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.972652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.972942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.973510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.973996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.974944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:10.975456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:10.977236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:10.985148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6589f0-eaab-4b8c-8641-be7a0909bfd6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:10.985690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 379/762] 10.222.0.11 () {56 vars in 1145 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:10.990124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:10.990986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:10.991261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:10.991526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:10.993285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:10.999541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:11.001522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:11.016837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:11.017282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b173-b5ab-4606-a082-022547c60e38 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:11.018344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 384/763] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:11.022016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:11.022776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:11.023063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:11.023684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:11.024423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:11.024531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:11.024821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:11.026341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:11.031993 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 380/764] 10.222.0.11 () {56 vars in 1145 bytes} [Thu Nov 11 16:15:10 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:11.034434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c79a76-f0eb-468a-bddf-5dea0007ca87 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:11.039237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:11.039385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:11.039878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:11.040232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:11.040421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:11.041222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:11.041523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:11.043378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:11.050512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca2f9-0657-45b2-b896-e54ba450e0d9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:11.056818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 385/765] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:11.057399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00f4ef-bedd-4c40-b6ca-96c8064f2fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:11.058169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f4ef-bedd-4c40-b6ca-96c8064f2fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:11.058499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f4ef-bedd-4c40-b6ca-96c8064f2fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:11.058776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f4ef-bedd-4c40-b6ca-96c8064f2fe4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:11.059639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00f4ef-bedd-4c40-b6ca-96c8064f2fe4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:11.060731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-9e00f4ef-bedd-4c40-b6ca-96c8064f2fe4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:11.060731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:15:11.060731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:15:11.061697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00f4ef-bedd-4c40-b6ca-96c8064f2fe4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:11.063165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:11.072840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc91dd2-8ea9-4f2e-b976-91d042c40167 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:11.079028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcd40b-d569-456f-a732-62776efc08b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:11.080759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcd40b-d569-456f-a732-62776efc08b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:11.080759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcd40b-d569-456f-a732-62776efc08b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:11.080759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcd40b-d569-456f-a732-62776efc08b3 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/43db7d84ce72442cbccd9ee65c70551b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:11.082971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcd40b-d569-456f-a732-62776efc08b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=43db7d84ce72442cbccd9ee65c70551b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:11.091599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcd40b-d569-456f-a732-62776efc08b3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:11.207723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 381/766] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:11 2021] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:11.247146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 386/767] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:15:11 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/43db7d84ce72442cbccd9ee65c70551b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:15:12.176430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dabd42-6831-45c0-97d8-5439bd776cab None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.177378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dabd42-6831-45c0-97d8-5439bd776cab None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.177849 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dabd42-6831-45c0-97d8-5439bd776cab None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.180071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 382/768] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:12.187096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17645d-a121-4b3f-b6fd-fb173f3fc0d1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.188068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17645d-a121-4b3f-b6fd-fb173f3fc0d1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.188574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17645d-a121-4b3f-b6fd-fb173f3fc0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.219469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ab17645d-a121-4b3f-b6fd-fb173f3fc0d1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:12.221062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ab17645d-a121-4b3f-b6fd-fb173f3fc0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:12.304889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 387/769] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:12 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:12.329227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dabd42-6831-45c0-97d8-5439bd776cab None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:12.345558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dabd42-6831-45c0-97d8-5439bd776cab None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:12.354317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:12.355123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.355401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.355676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.356355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:12.356468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678161-3d5b-4d21-8c06-6a2b4ef7ddfc None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.356727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678161-3d5b-4d21-8c06-6a2b4ef7ddfc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.357014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678161-3d5b-4d21-8c06-6a2b4ef7ddfc None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.358869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:12.359864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 388/770] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:12.365928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed5be-d56a-4f29-8024-aef90aeea15c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.365928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed5be-d56a-4f29-8024-aef90aeea15c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.366144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed5be-d56a-4f29-8024-aef90aeea15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.376647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 11 16:15:12.380553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 383/771] 10.222.0.11 () {56 vars in 1153 bytes} [Thu Nov 11 16:15:12 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:12.392897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c26ed5be-d56a-4f29-8024-aef90aeea15c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:12.393181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:12.394097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c26ed5be-d56a-4f29-8024-aef90aeea15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:12.406408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 389/772] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:12 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:12.416572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8f77a-66a6-475c-8075-2acef175c0ef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:12.427581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ed5be-d56a-4f29-8024-aef90aeea15c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:12.432060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:12.432733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.433622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.433902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.434951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:12.435262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:12.437428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:12.437612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ed5be-d56a-4f29-8024-aef90aeea15c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:12.443309 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 384/773] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:12 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:12.445277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:12.446076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.446383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.446660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] PATH_INFO: `/v3/services/network` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.447341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:12.449042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:12.449230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:12.467405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 11 16:15:12.470858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062609b-01da-4c95-8995-a89482a07fda admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:12.472958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 390/774] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:12 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:12.476703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:12.477498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.477783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.478059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.478818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:12.479124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:12.480894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:12.486779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:12.493719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06993830-28b4-444e-a149-6d0e8cadf9ca admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:12.496292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 385/775] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:12 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:12.500420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:12.501086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.501372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.501648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.502412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:12.502724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:12.504347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:12.517040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 391/776] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:12 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:12.523586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:12.538893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933016-0bba-4adb-b08b-9b838df86eef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:12.550696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfec09a-ebf6-4e80-a58d-b452cd37708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:12.551571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfec09a-ebf6-4e80-a58d-b452cd37708e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.551957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfec09a-ebf6-4e80-a58d-b452cd37708e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.552377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfec09a-ebf6-4e80-a58d-b452cd37708e admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.553215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfec09a-ebf6-4e80-a58d-b452cd37708e admin admin] RBAC: Adding query filter params (type=network) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:12.553644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfec09a-ebf6-4e80-a58d-b452cd37708e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:12.555427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfec09a-ebf6-4e80-a58d-b452cd37708e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:12.566831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 386/777] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:12 2021] GET /identity/v3/services?type=network => generated 350 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:12.572720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:12.587442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcc4a8-5291-4135-abd9-44d58616bee1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:12.598344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252799d-854a-4acd-963a-dc373ec8aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:12.599347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252799d-854a-4acd-963a-dc373ec8aeda admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:12.599811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252799d-854a-4acd-963a-dc373ec8aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:12.600259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252799d-854a-4acd-963a-dc373ec8aeda admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:12.601217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252799d-854a-4acd-963a-dc373ec8aeda admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:12.602584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-a252799d-854a-4acd-963a-dc373ec8aeda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:12.602584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:15:12.602584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:15:12.603795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252799d-854a-4acd-963a-dc373ec8aeda admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:12.709376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 392/778] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:12 2021] POST /identity/v3/endpoints => generated 327 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:13.432856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d93b0-13bd-4936-ad93-9bf2f144a63f None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.433401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d93b0-13bd-4936-ad93-9bf2f144a63f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.433401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d93b0-13bd-4936-ad93-9bf2f144a63f None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.435556 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 387/779] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:13.442140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2206-9db1-4c11-9d7d-b99fd5e5a20b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.442638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2206-9db1-4c11-9d7d-b99fd5e5a20b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.442712 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2206-9db1-4c11-9d7d-b99fd5e5a20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.463342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-66de2206-9db1-4c11-9d7d-b99fd5e5a20b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:13.464523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-66de2206-9db1-4c11-9d7d-b99fd5e5a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:13.482307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 393/780] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:13 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:13.524054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d93b0-13bd-4936-ad93-9bf2f144a63f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.549587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d93b0-13bd-4936-ad93-9bf2f144a63f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.554020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.554843 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.555126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.555405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.566124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:13.573062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:15:13.574614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 388/781] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:13.581249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2206-9db1-4c11-9d7d-b99fd5e5a20b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.590378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2206-9db1-4c11-9d7d-b99fd5e5a20b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.595489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.596149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.596434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.596715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.597489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:13.597803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.599441 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.609114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 394/782] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:13.615823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.626867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d605fd9-4f3c-4f44-9dba-3d8604aa15f1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.631493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.632275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.632557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.632830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.644938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.646837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.663356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:13.664896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 389/783] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:13.671274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.681124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32683-74ea-4e17-9357-1f3e462c5b40 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.685862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.687068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.687420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.687747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.688507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:13.688815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.690468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.703676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 395/784] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:13.709606 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.719603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4476bb7-efb5-4ebb-9e49-707fabd452fb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.724236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.725090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.725376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.725714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.734300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.736331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.751066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:15:13.752555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 390/785] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:13.758767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.769722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64df85-5893-4402-b7f8-dc4ec3756b98 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.774493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.775204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.775489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.775825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.776682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:13.777047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.779195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.798795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 396/786] 10.222.0.11 () {56 vars in 1170 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:13.805008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.816058 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67038e11-ad8d-40c0-9345-f940ade2019a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.820931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.821661 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.821999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.822330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.831812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.833629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.844459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 391/787] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:13.851081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.862279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67385a-6d7c-4793-b888-ff8fe8df9272 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.866886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.867665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.867941 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.868212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.879198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.881143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.899721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:13.901357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 397/788] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:13.907564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.917120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca147-3474-4c79-bb4c-82e4df989b86 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.923092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc476cd-2a6a-4793-a852-3b7f99f3b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.923790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc476cd-2a6a-4793-a852-3b7f99f3b9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.924076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc476cd-2a6a-4793-a852-3b7f99f3b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.924355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc476cd-2a6a-4793-a852-3b7f99f3b9a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.925153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc476cd-2a6a-4793-a852-3b7f99f3b9a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:13.925462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc476cd-2a6a-4793-a852-3b7f99f3b9a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.927203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc476cd-2a6a-4793-a852-3b7f99f3b9a1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.941393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 392/789] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:13.947536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:13.958039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5df8a-e1da-4ec3-affb-5e6016b2f30d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:13.962757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:13.963577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.963863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.964142 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.973220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:13.975312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:13.987065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46521-4cb0-447d-a561-f00fa50c44fd None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.987361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46521-4cb0-447d-a561-f00fa50c44fd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.987709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46521-4cb0-447d-a561-f00fa50c44fd None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.989359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:13.989712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 393/790] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:13.990829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 398/791] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:13.996141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3490-4b3b-4e68-8bfa-389b957bdfff None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:13.996433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3490-4b3b-4e68-8bfa-389b957bdfff None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:13.996715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3490-4b3b-4e68-8bfa-389b957bdfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:13.999195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.009876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211b2fc-99be-4ad4-bb41-dc6301dab320 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.016943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.017680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.018050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.018529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.019340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.019648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.021482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.023254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-401a3490-4b3b-4e68-8bfa-389b957bdfff None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:14.024526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-401a3490-4b3b-4e68-8bfa-389b957bdfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:14.037798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 399/793] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:14.038324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 394/793] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:13 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:14.048189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.058228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0f60-ebb0-4cfb-aa47-2f096761c87c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.058834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0f60-ebb0-4cfb-aa47-2f096761c87c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.059293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5da30b-765d-47ee-9306-7e3e9a2a60d9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.059424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0f60-ebb0-4cfb-aa47-2f096761c87c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.061290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 395/794] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:14.061955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0f60-ebb0-4cfb-aa47-2f096761c87c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.065814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd6640-cc83-460c-a3a2-ef79f97414e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.066552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd6640-cc83-460c-a3a2-ef79f97414e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.066836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd6640-cc83-460c-a3a2-ef79f97414e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.067112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd6640-cc83-460c-a3a2-ef79f97414e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.067983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd6640-cc83-460c-a3a2-ef79f97414e4 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=9f7408badb7143c097d6450cb1e2ec8b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.068276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd6640-cc83-460c-a3a2-ef79f97414e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.070156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd6640-cc83-460c-a3a2-ef79f97414e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.075137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0f60-ebb0-4cfb-aa47-2f096761c87c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.078242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 400/795] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/role_assignments?user.id=9f7408badb7143c097d6450cb1e2ec8b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:14.078365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1d0e1-82c3-4131-a62f-ab41b48dd7bf None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.078627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1d0e1-82c3-4131-a62f-ab41b48dd7bf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.078909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1d0e1-82c3-4131-a62f-ab41b48dd7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.082456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.083604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.084122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.084616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.097207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:14.099926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-30c1d0e1-82c3-4131-a62f-ab41b48dd7bf None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:14.101166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-30c1d0e1-82c3-4131-a62f-ab41b48dd7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:14.105845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:14.108626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 396/796] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:14.109991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 401/797] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:14 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:14.115475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.128799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668f4ad-673f-423d-adc7-5a898d110b08 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.133729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.134732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.135014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.135112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1d0e1-82c3-4131-a62f-ab41b48dd7bf None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.135293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.136186 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.136491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.138163 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.145730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1d0e1-82c3-4131-a62f-ab41b48dd7bf None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.151548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.152419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.152710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.152982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.153667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.154326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 397/798] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:14.155509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.157286 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.168575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273b34-b001-4f65-934e-e87cb26790de admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.168770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 11 16:15:14.174335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 402/799] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:14.179435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.186770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.187572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.187855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.188130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.195623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dad1-958a-4872-a47f-b51c7100de2e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.200730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.201796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.201796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.202081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.203190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.203375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.205036 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.205889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.208813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.215223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 403/800] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:14.217923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.228725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4c43-2f6e-47bf-9434-21512dc24af6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.233671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.234486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.234770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.235047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.235843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.236151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.237642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:14.237860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.239673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 398/801] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:14.247154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.250819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 404/802] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:14.260548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6879638-6c18-47be-9605-c522d18f299f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.265898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.266626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.266911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.267188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.267967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.268282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.270122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.284867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 399/803] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:14.291855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.302812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f875c60-e39e-4a2d-a7fc-aa9b88834ff5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.309510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.309510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.309510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.309510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.320071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.322166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.337996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:15:14.339623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 405/804] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:14.346162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.357401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dae325-8576-4a8e-a678-b83d5ca3c727 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.362363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.363052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.363326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.363607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.364485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.364796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.366716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.389942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 400/805] 10.222.0.11 () {56 vars in 1156 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:14.396499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.408429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0b13a-9e44-4584-9e0c-02e1e5337e57 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.414826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.415484 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.415767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.416041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.427802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.429685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.441793 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 406/806] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:14.448176 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.459832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc9d3f-9326-4e37-bd9a-0b90b06e5111 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.465017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.466157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.466691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.467615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.479778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.481994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.502892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:14.504701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 401/807] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:14.511149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.521893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb0e4c-58b6-42f7-855e-54a2d4370be1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.526934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.527816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.528318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.528774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.530370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.530863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.532815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.553430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 407/808] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:14.559965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.570164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd12d04-0637-4ea4-a3cb-0a6a3c4ff221 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.574746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.575526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.575806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.576072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.584333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.586310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.600132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:14.606285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 402/809] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:14.609597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.619574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869aa2d-c355-4439-a108-a70cbb1cff66 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.624314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096ab35-baae-4e52-bd4e-776fa441b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.625024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ab35-baae-4e52-bd4e-776fa441b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.625305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ab35-baae-4e52-bd4e-776fa441b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.625576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ab35-baae-4e52-bd4e-776fa441b5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.626504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096ab35-baae-4e52-bd4e-776fa441b5d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.626810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096ab35-baae-4e52-bd4e-776fa441b5d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.628761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096ab35-baae-4e52-bd4e-776fa441b5d1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.642006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 408/810] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:14.648915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:14.660465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8e08-b857-452d-8be0-4cee59de6c99 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:14.665136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2a58d-545f-43b9-b408-38ee25b18ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:14.665822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a58d-545f-43b9-b408-38ee25b18ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:14.666110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a58d-545f-43b9-b408-38ee25b18ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:14.666476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2a58d-545f-43b9-b408-38ee25b18ba0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:14.667326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2a58d-545f-43b9-b408-38ee25b18ba0 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=43db7d84ce72442cbccd9ee65c70551b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:14.667689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2a58d-545f-43b9-b408-38ee25b18ba0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:14.669666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2a58d-545f-43b9-b408-38ee25b18ba0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:14.676204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 403/811] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:14 2021] GET /identity/v3/role_assignments?user.id=43db7d84ce72442cbccd9ee65c70551b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:15.055295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff14d3-1fa2-4b8e-898a-e54af839e15c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:15.055672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff14d3-1fa2-4b8e-898a-e54af839e15c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:15.055874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff14d3-1fa2-4b8e-898a-e54af839e15c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:15.057823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 409/812] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:15.064663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d33e38-90e1-40c1-b536-1f97578b0b37 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:15.064958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d33e38-90e1-40c1-b536-1f97578b0b37 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:15.065237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d33e38-90e1-40c1-b536-1f97578b0b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:15.083494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-23d33e38-90e1-40c1-b536-1f97578b0b37 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:15.084959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-23d33e38-90e1-40c1-b536-1f97578b0b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:15.093820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 404/813] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:15 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:15.118357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff14d3-1fa2-4b8e-898a-e54af839e15c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:15.130863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff14d3-1fa2-4b8e-898a-e54af839e15c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:15.135581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1b69b-cac7-464e-96e5-3596ea99e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:15.136232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b69b-cac7-464e-96e5-3596ea99e66a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:15.136516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b69b-cac7-464e-96e5-3596ea99e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:15.136789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b69b-cac7-464e-96e5-3596ea99e66a admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:15.137546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1b69b-cac7-464e-96e5-3596ea99e66a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:15.139226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1b69b-cac7-464e-96e5-3596ea99e66a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:15.234251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 410/814] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:15 2021] POST /identity/v3/services => generated 269 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:16.591716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fc6f0-95dc-4820-aa6f-562253b14c8f None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.592919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fc6f0-95dc-4820-aa6f-562253b14c8f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.592998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fc6f0-95dc-4820-aa6f-562253b14c8f None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.595281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 405/815] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:16.601707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6be6e-55c8-4197-a969-d440b3946949 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.602602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6be6e-55c8-4197-a969-d440b3946949 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.603076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6be6e-55c8-4197-a969-d440b3946949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.621672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-50e6be6e-55c8-4197-a969-d440b3946949 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:16.623257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-50e6be6e-55c8-4197-a969-d440b3946949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:16.640035 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 411/816] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:16 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:16.649208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbd16-8b35-4baa-820c-6bcccf80957b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.649683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbd16-8b35-4baa-820c-6bcccf80957b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.650136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbd16-8b35-4baa-820c-6bcccf80957b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.652295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 406/817] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:16.658848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ccdf-8518-411e-ac87-cdba1c88c16d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.659363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ccdf-8518-411e-ac87-cdba1c88c16d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.659814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ccdf-8518-411e-ac87-cdba1c88c16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.667335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbbd16-8b35-4baa-820c-6bcccf80957b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.679078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9787ccdf-8518-411e-ac87-cdba1c88c16d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:16.680389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbbd16-8b35-4baa-820c-6bcccf80957b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.680515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9787ccdf-8518-411e-ac87-cdba1c88c16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:16.685081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.686778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.687259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.687724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.689608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 412/818] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:16 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:16.698788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:16.706986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:15:16.708700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 407/819] 10.222.0.11 () {56 vars in 1141 bytes} [Thu Nov 11 16:15:16 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:16.714086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ccdf-8518-411e-ac87-cdba1c88c16d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.715125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.724995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ccdf-8518-411e-ac87-cdba1c88c16d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.725525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba5f2-34ab-4e07-b234-d1db3c4750c0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.730898 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.731552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.731831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.732104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.732941 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:16.734551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:16.734824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.735502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.735789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.736069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.736841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:16.737151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:16.738866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:16.748020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 408/820] 10.222.0.11 () {56 vars in 1136 bytes} [Thu Nov 11 16:15:16 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:16.754671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.765063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25c593-49ef-4de7-97cd-5d5313b7448d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.769457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.770245 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.770537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.770814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.780970 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:16.782796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:16.809105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:16.809105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 409/821] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:16.809105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.817670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c64cf6-24c1-4c43-a343-5c525c0d3172 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.822035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.822718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.823004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.823281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.824021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:16.824330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:16.825922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:16.836148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 413/822] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:16 2021] POST /identity/v3/services => generated 251 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:16.841864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 410/823] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:16.849019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.873763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98338a7-26cc-48d2-b3e2-5e4612f8adb2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.879295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.880689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.881190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.881731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.891355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:16.893859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:16.910658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:15:16.912783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 414/824] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:15:16 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:16.919437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.931130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbcc1c-3b98-47ca-995c-5b5a4f7433a5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.936884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.938041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.938605 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.939141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.940220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:16.940767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:16.942961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:16.963668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 411/825] 10.222.0.11 () {56 vars in 1170 bytes} [Thu Nov 11 16:15:16 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:16.970999 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:16.981741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45972ee7-7d98-41b3-9390-2c322c53e597 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:16.987685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ae693-184e-4b47-ad64-0369e523dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:16.988690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae693-184e-4b47-ad64-0369e523dc26 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:16.989222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae693-184e-4b47-ad64-0369e523dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:16.989691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ae693-184e-4b47-ad64-0369e523dc26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:16.999338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ae693-184e-4b47-ad64-0369e523dc26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.001583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ae693-184e-4b47-ad64-0369e523dc26 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.012633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 415/826] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:16 2021] GET /identity/v3/auth/tokens => generated 1663 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:17.020059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.030829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6a85d-900c-45e3-bad6-2b88ecb33e16 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.031020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544ea4-6ad6-446c-95e0-b274d9821742 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.031236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544ea4-6ad6-446c-95e0-b274d9821742 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.031511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544ea4-6ad6-446c-95e0-b274d9821742 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.034744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 416/827] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:17.035608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.036425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.036713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.036992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.039961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b9f2-a683-4a20-9847-059dc5d3fbe5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.040250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b9f2-a683-4a20-9847-059dc5d3fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.040535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b9f2-a683-4a20-9847-059dc5d3fbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.050234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.052392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.062678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6428b9f2-a683-4a20-9847-059dc5d3fbe5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:17.064251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6428b9f2-a683-4a20-9847-059dc5d3fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:17.075119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:17.077553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 417/829] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:17 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:17.082315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 412/829] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:17.083866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b9f2-a683-4a20-9847-059dc5d3fbe5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.093598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b9f2-a683-4a20-9847-059dc5d3fbe5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.098499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.099282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.099632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.099979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.100920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.101252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.102103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.103087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.113449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e8c9d-12a4-4fb3-9169-67d6e20b4aaa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.118039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.118875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.119162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.119515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.119881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 418/830] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:17.120114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.121703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.126874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.136290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:15:17.139657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 413/831] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:17.143811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c706-7176-486c-83c8-0ef1f8141087 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.147936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.151794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.152754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.153180 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.153574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.158908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d5018-001c-4b6f-9819-6f8dd079f938 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.162110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.163889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.164702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.164845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.165259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.165681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.166597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.167065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.168782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.174957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 414/832] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:17.184716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:17.186774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 419/833] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:17.187481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.195442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.202225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179ab60-881b-4c56-b5fb-502f57dbc7eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.206365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64dec4-eea6-477e-a110-e86b7ff5b5e5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.208388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.209277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.209785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.210370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.211305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.211667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf8c3c-861f-4147-bbe7-96c5b818e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.212022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.212524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8c3c-861f-4147-bbe7-96c5b818e971 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.212909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8c3c-861f-4147-bbe7-96c5b818e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.213289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8c3c-861f-4147-bbe7-96c5b818e971 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.214205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf8c3c-861f-4147-bbe7-96c5b818e971 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.214501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.214715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf8c3c-861f-4147-bbe7-96c5b818e971 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.216632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf8c3c-861f-4147-bbe7-96c5b818e971 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.226861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 415/834] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:17.232645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 420/835] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:17.239280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.250850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebacce-bad7-49c0-9cd2-bce7a597525f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.256075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04261acd-f6e6-4d47-b8ae-d21b1e966b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.262397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261acd-f6e6-4d47-b8ae-d21b1e966b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.262397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261acd-f6e6-4d47-b8ae-d21b1e966b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.262397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04261acd-f6e6-4d47-b8ae-d21b1e966b67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.262397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04261acd-f6e6-4d47-b8ae-d21b1e966b67 admin admin] RBAC: Adding query filter params (role.id=e35ffe4e61064f628e64df44ac5bdb8c, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=9f7408badb7143c097d6450cb1e2ec8b) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.262397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04261acd-f6e6-4d47-b8ae-d21b1e966b67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.262769 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04261acd-f6e6-4d47-b8ae-d21b1e966b67 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.267840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 416/836] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/role_assignments?user.id=9f7408badb7143c097d6450cb1e2ec8b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=e35ffe4e61064f628e64df44ac5bdb8c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:17.600638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6160-f3ba-4b2e-b9ab-4bc11a6f13dd None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.600926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6160-f3ba-4b2e-b9ab-4bc11a6f13dd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.601196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6160-f3ba-4b2e-b9ab-4bc11a6f13dd None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.602999 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 421/837] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:17.609703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617cd1-8326-4520-9bf7-82bc8cb683e9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.610132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617cd1-8326-4520-9bf7-82bc8cb683e9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.610374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617cd1-8326-4520-9bf7-82bc8cb683e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.628877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5c617cd1-8326-4520-9bf7-82bc8cb683e9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:17.630367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5c617cd1-8326-4520-9bf7-82bc8cb683e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:17.639412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 417/838] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:17 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:17.663305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6160-f3ba-4b2e-b9ab-4bc11a6f13dd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.676739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6160-f3ba-4b2e-b9ab-4bc11a6f13dd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.681603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.682711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.683210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.683787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.684705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.686736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.698891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 11 16:15:17.700560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 422/839] 10.222.0.11 () {56 vars in 1153 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:17.709235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c617cd1-8326-4520-9bf7-82bc8cb683e9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.719148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c617cd1-8326-4520-9bf7-82bc8cb683e9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.723708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.724420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.724711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.724991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.725739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.726036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.727655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.732746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 418/840] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:17.739114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.749093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7b389-ac3d-4a24-90af-0feb2ba7de51 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.753832 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.754865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.755350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.755818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.756736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.757231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.759476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.765670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 423/841] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:17.772336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.784140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b234116-3ead-427a-b114-22ff92dc5177 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.788998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb80dbf-e752-40a3-8639-3493a2ee2d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.789595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb80dbf-e752-40a3-8639-3493a2ee2d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.789927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb80dbf-e752-40a3-8639-3493a2ee2d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.790242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb80dbf-e752-40a3-8639-3493a2ee2d8e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.791113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb80dbf-e752-40a3-8639-3493a2ee2d8e admin admin] RBAC: Adding query filter params (interface=public, service_id=7776743b478a4dc5a4a7cf1b2da5cdaf, region_id=RegionOne) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:17.791428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb80dbf-e752-40a3-8639-3493a2ee2d8e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.793061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb80dbf-e752-40a3-8639-3493a2ee2d8e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.798777 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 419/842] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/endpoints?service_id=7776743b478a4dc5a4a7cf1b2da5cdaf&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:17.804814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:17.814736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d88ca-f167-4bf1-8e77-8e7a7cd8a71e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:17.819255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3696f0-b1b9-4e87-b316-f42d6ebab351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:17.819895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3696f0-b1b9-4e87-b316-f42d6ebab351 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:17.820177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3696f0-b1b9-4e87-b316-f42d6ebab351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:17.820452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3696f0-b1b9-4e87-b316-f42d6ebab351 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:17.821140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3696f0-b1b9-4e87-b316-f42d6ebab351 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:17.822754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3696f0-b1b9-4e87-b316-f42d6ebab351 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:17.829974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 424/843] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:17 2021] GET /identity/v3/services => generated 1268 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:15:19.420172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5c24-e279-4f58-90a8-496184182c95 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.420870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5c24-e279-4f58-90a8-496184182c95 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.420870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d5c24-e279-4f58-90a8-496184182c95 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.422897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 420/844] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:19.429141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958debb-8dde-4a38-8e15-71422febbea9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.429617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958debb-8dde-4a38-8e15-71422febbea9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.429699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958debb-8dde-4a38-8e15-71422febbea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.448349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b958debb-8dde-4a38-8e15-71422febbea9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:19.449534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b958debb-8dde-4a38-8e15-71422febbea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:19.457909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 425/845] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:19 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:19.483536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d5c24-e279-4f58-90a8-496184182c95 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.496186 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d5c24-e279-4f58-90a8-496184182c95 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.501031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.501829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.502115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.502422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.503102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.504699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.516638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 11 16:15:19.518125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 421/846] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:19.525977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958debb-8dde-4a38-8e15-71422febbea9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.546198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958debb-8dde-4a38-8e15-71422febbea9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.550873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.551530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.551811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.552084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.552810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:19.553115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.554741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.559923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 426/847] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:19.566228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.576114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55937ab2-6e87-4b53-b59c-b36013afded3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.581075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f62e99-248c-4ebb-ba2e-b8daa9778aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.581735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62e99-248c-4ebb-ba2e-b8daa9778aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.582017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62e99-248c-4ebb-ba2e-b8daa9778aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.582344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62e99-248c-4ebb-ba2e-b8daa9778aaa admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.583072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f62e99-248c-4ebb-ba2e-b8daa9778aaa admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:19.583376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f62e99-248c-4ebb-ba2e-b8daa9778aaa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.584957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f62e99-248c-4ebb-ba2e-b8daa9778aaa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.594504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 422/848] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:19.597489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.607489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6700-a45a-431e-8802-1ca03c98741c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.612123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a57c6-cbcf-442d-b106-4baa8154c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.612788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a57c6-cbcf-442d-b106-4baa8154c00c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.613070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a57c6-cbcf-442d-b106-4baa8154c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.613346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a57c6-cbcf-442d-b106-4baa8154c00c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.614166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a57c6-cbcf-442d-b106-4baa8154c00c admin admin] RBAC: Adding query filter params (interface=public, service_id=2b584225b8e640c18c7e90a3356c2127, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:19.614513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a57c6-cbcf-442d-b106-4baa8154c00c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.616174 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a57c6-cbcf-442d-b106-4baa8154c00c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.624332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbcb7-6ef9-4205-819f-5ffe2fcfa16c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.624664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbcb7-6ef9-4205-819f-5ffe2fcfa16c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.624878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbcb7-6ef9-4205-819f-5ffe2fcfa16c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.627093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 427/849] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/endpoints?service_id=2b584225b8e640c18c7e90a3356c2127&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:19.634839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 423/850] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:19.634839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bbcb7-6ef9-4205-819f-5ffe2fcfa16c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.635369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c185-5cea-43be-992d-7fad3228fbae None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.635369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c185-5cea-43be-992d-7fad3228fbae None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.635369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c185-5cea-43be-992d-7fad3228fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.655830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bbcb7-6ef9-4205-819f-5ffe2fcfa16c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.657354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8169c185-5cea-43be-992d-7fad3228fbae None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:19.659082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8169c185-5cea-43be-992d-7fad3228fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:19.660586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.661385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.661729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.662078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.662875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.664539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.674273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 428/851] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:19 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:19.678418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 424/852] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/services => generated 1268 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:15:19.693831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169c185-5cea-43be-992d-7fad3228fbae None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.703760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169c185-5cea-43be-992d-7fad3228fbae None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.708730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d43c8-fd98-468f-b80c-08ff9fe3dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.709884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d43c8-fd98-468f-b80c-08ff9fe3dbbc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.710451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d43c8-fd98-468f-b80c-08ff9fe3dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.710899 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d43c8-fd98-468f-b80c-08ff9fe3dbbc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.723811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d43c8-fd98-468f-b80c-08ff9fe3dbbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:19.731622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6d7d43c8-fd98-468f-b80c-08ff9fe3dbbc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:15:19.733777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 429/853] 10.222.0.11 () {56 vars in 1141 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:19.743023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.756551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e97e7-09e5-41d5-8492-1b3cc9b28aa2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.761837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.762941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.763624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.764082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.765244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:19.765752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.767669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.778833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ebc8a-ec43-42cd-8fe9-7041dbd6a021 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.780100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ebc8a-ec43-42cd-8fe9-7041dbd6a021 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.780381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 425/854] 10.222.0.11 () {56 vars in 1136 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:19.780759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ebc8a-ec43-42cd-8fe9-7041dbd6a021 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.783096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 430/855] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:19.788531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.792394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d08f1-2c86-4ffb-b8bf-ed59a2b380d9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.792686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d08f1-2c86-4ffb-b8bf-ed59a2b380d9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.792967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d08f1-2c86-4ffb-b8bf-ed59a2b380d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.801760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cee1c-fc5b-4340-aabc-5eac9d033e8e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.806848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.807999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.808480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.808967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.813338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7e1d08f1-2c86-4ffb-b8bf-ed59a2b380d9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:19.814661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7e1d08f1-2c86-4ffb-b8bf-ed59a2b380d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:19.829401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 431/856] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:19 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:19.829612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.830245 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.849658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d08f1-2c86-4ffb-b8bf-ed59a2b380d9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.851956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:19.853548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 426/857] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:19.860618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d08f1-2c86-4ffb-b8bf-ed59a2b380d9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.861293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.865897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.866927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.867407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.867883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.868720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.870617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.872396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298035d-b7d1-4cf8-a0fe-9bf8d8fd0dd1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.878640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.879323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.879599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.879875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.880629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:19.880933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.882554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.898225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 427/858] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:19.901841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.912411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa4d1-92d7-4799-8399-5b2bc88fd8e2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.916918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.917743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.918009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.918311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.927993 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.930372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:19.945203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:15:19.946805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 428/859] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:19.953246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:19.965415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 432/860] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:19 2021] POST /identity/v3/services => generated 241 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:19.965932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f922d-296b-4071-91da-53adadd56aa2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:19.984305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:19.985510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:19.986118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:19.986644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:19.987796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:19.988325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:19.990716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.015150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 429/861] 10.222.0.11 () {56 vars in 1170 bytes} [Thu Nov 11 16:15:19 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:20.021099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.032163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7363c-a258-4f60-8582-09e98e0f02bc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.037138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.037969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.038303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.038581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.051465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.053391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.073018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:20.074622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 433/862] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:20.081370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.092594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ca79f-88b9-4a33-98b0-a101f32f9b46 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.097521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.098369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.098779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.099154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.100067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:20.100472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.102294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.116994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 430/863] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:20.123368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.135684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4e53d-413e-4aad-b4b8-e5b151314a47 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.141914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7cac0-ce72-48c1-8591-0272230ae85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.142947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cac0-ce72-48c1-8591-0272230ae85c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.143330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cac0-ce72-48c1-8591-0272230ae85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.143786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7cac0-ce72-48c1-8591-0272230ae85c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.152218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7cac0-ce72-48c1-8591-0272230ae85c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.154874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7cac0-ce72-48c1-8591-0272230ae85c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.169416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a8b7cac0-ce72-48c1-8591-0272230ae85c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:20.172542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 434/864] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:20.179604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.190269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17057239-888e-46ae-979e-9d8b514c4128 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.195235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.196148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.196598 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.197079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.198201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:20.198688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.199713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94c7d-0242-4342-9761-20507fe128be None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.200008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94c7d-0242-4342-9761-20507fe128be None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.200287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94c7d-0242-4342-9761-20507fe128be None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.201516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.202522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 435/865] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:20.208466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d38d0-8132-4a64-9075-674becdf47c6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.208756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d38d0-8132-4a64-9075-674becdf47c6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.209041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d38d0-8132-4a64-9075-674becdf47c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.216120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 431/866] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:20.223066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.231518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d06d38d0-8132-4a64-9075-674becdf47c6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:20.233529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d06d38d0-8132-4a64-9075-674becdf47c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:20.233799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33138a1-ae5e-4c4d-8be4-09ff2e1776c0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.238555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.239422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.239705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.239974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/9f7408badb7143c097d6450cb1e2ec8b/roles/e35ffe4e61064f628e64df44ac5bdb8c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.242089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 436/867] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:20 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:20.242237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=9f7408badb7143c097d6450cb1e2ec8b, role_id=e35ffe4e61064f628e64df44ac5bdb8c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.244838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.271557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d38d0-8132-4a64-9075-674becdf47c6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.280776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d38d0-8132-4a64-9075-674becdf47c6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.285348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.286130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.286473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.286747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.287422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.289107 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.302407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 11 16:15:20.304977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 437/868] 10.222.0.11 () {56 vars in 1153 bytes} [Thu Nov 11 16:15:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:20.308198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 432/869] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:15:20 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/9f7408badb7143c097d6450cb1e2ec8b/roles/e35ffe4e61064f628e64df44ac5bdb8c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:15:20.315127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.326558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423f72-8628-4579-8acb-03f2aa78f88f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.392345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.393397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.393905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.394441 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.395371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:20.395863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.397821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.404854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 438/870] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:20.411632 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.423313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3e42f-2825-41db-8dc2-3747f80d66a8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.428929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d6b97-4b64-4237-a70f-c781dfb838fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.429967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6b97-4b64-4237-a70f-c781dfb838fe admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.430498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6b97-4b64-4237-a70f-c781dfb838fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.430954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6b97-4b64-4237-a70f-c781dfb838fe admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.431881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d6b97-4b64-4237-a70f-c781dfb838fe admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:20.432374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d6b97-4b64-4237-a70f-c781dfb838fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.434306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d6b97-4b64-4237-a70f-c781dfb838fe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.440915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 433/871] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:20.447591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:20.459150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b801a6-c57f-4c7b-95bb-ab522a52bc9c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:20.464131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e49d-7c90-46ab-93e5-11369a23ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:20.465089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e49d-7c90-46ab-93e5-11369a23ad25 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:20.465627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e49d-7c90-46ab-93e5-11369a23ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:20.466087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e49d-7c90-46ab-93e5-11369a23ad25 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:20.467761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e49d-7c90-46ab-93e5-11369a23ad25 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:20.469738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083e49d-7c90-46ab-93e5-11369a23ad25 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:20.547367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 439/872] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:20 2021] POST /identity/v3/endpoints => generated 347 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:22.030391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859cb85-0d1c-486b-8390-6f3b43c7fde0 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.031424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859cb85-0d1c-486b-8390-6f3b43c7fde0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.031919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859cb85-0d1c-486b-8390-6f3b43c7fde0 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.034212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 434/873] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:22.040483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584265ac-78e8-45f4-beb9-6f5642a118c3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.040944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584265ac-78e8-45f4-beb9-6f5642a118c3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.041018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584265ac-78e8-45f4-beb9-6f5642a118c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.061563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-584265ac-78e8-45f4-beb9-6f5642a118c3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:22.062785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-584265ac-78e8-45f4-beb9-6f5642a118c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:22.086295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 440/874] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:22 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:22.111886 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859cb85-0d1c-486b-8390-6f3b43c7fde0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.124483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859cb85-0d1c-486b-8390-6f3b43c7fde0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.129023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.129808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.130091 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.130400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.131073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.132666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.145607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 11 16:15:22.150013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 435/875] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:22.159610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584265ac-78e8-45f4-beb9-6f5642a118c3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.168812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584265ac-78e8-45f4-beb9-6f5642a118c3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.173677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.174388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.174671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.174947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.175684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:22.175989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.177617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.188651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 441/876] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:22.189994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.200042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1645-be5f-4115-bcfc-95763b81c961 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.205428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52e7a0-9608-4d67-82d6-505a9b012841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.206089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52e7a0-9608-4d67-82d6-505a9b012841 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.206406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52e7a0-9608-4d67-82d6-505a9b012841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.206681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52e7a0-9608-4d67-82d6-505a9b012841 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.207411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52e7a0-9608-4d67-82d6-505a9b012841 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:22.207715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52e7a0-9608-4d67-82d6-505a9b012841 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.209299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52e7a0-9608-4d67-82d6-505a9b012841 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.221222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 436/877] 10.222.0.11 () {56 vars in 1135 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:22.222603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.237346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14b8f-3aa8-44ce-a879-4d1a05b9c191 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.244749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766b2ea-bca8-446c-af88-29ba88a9505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.245418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766b2ea-bca8-446c-af88-29ba88a9505b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.245700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766b2ea-bca8-446c-af88-29ba88a9505b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.245979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766b2ea-bca8-446c-af88-29ba88a9505b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.246783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766b2ea-bca8-446c-af88-29ba88a9505b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.250585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766b2ea-bca8-446c-af88-29ba88a9505b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.354561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 442/878] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:22 2021] POST /identity/v3/endpoints => generated 346 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:22.500363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59221-a179-4aa7-a63c-edeff874c3f5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.500693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59221-a179-4aa7-a63c-edeff874c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.500954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59221-a179-4aa7-a63c-edeff874c3f5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.503329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 437/879] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:22.510008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbad4d-0d56-4d30-bd47-f418fc1ad2a0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.510327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbad4d-0d56-4d30-bd47-f418fc1ad2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.510603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbad4d-0d56-4d30-bd47-f418fc1ad2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.532342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-abdbad4d-0d56-4d30-bd47-f418fc1ad2a0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:22.533625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-abdbad4d-0d56-4d30-bd47-f418fc1ad2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:22.555455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 443/880] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:22 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:22.581409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a59221-a179-4aa7-a63c-edeff874c3f5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.594716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a59221-a179-4aa7-a63c-edeff874c3f5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.600197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.601003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.601289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.601561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.602266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.603917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.616722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:15:22.618247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 438/881] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:22.627504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbad4d-0d56-4d30-bd47-f418fc1ad2a0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.637499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbad4d-0d56-4d30-bd47-f418fc1ad2a0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.644826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.645505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.645792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.646144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.647000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:22.647307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.648938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.655444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 444/882] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:22.662325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.674330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21971fe-02b4-4c26-afdb-233c748243bd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.681322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2421625-d64d-4a9a-a0f4-10397c88d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.682462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2421625-d64d-4a9a-a0f4-10397c88d610 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.682987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2421625-d64d-4a9a-a0f4-10397c88d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.683445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2421625-d64d-4a9a-a0f4-10397c88d610 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.684731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2421625-d64d-4a9a-a0f4-10397c88d610 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:22.685334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2421625-d64d-4a9a-a0f4-10397c88d610 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.687640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2421625-d64d-4a9a-a0f4-10397c88d610 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.694523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 439/883] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:22.700766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.705967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09261-989f-47d0-9e92-b62de64c0b2b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.705967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09261-989f-47d0-9e92-b62de64c0b2b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.705967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09261-989f-47d0-9e92-b62de64c0b2b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.708229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 440/884] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:22.712917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2d337-a415-4795-bff4-c0955a5bfb1c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.715692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e198232-9189-413b-b443-97d2e7bca437 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.715981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e198232-9189-413b-b443-97d2e7bca437 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.716887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e198232-9189-413b-b443-97d2e7bca437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.718686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.719411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.719820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.720175 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.721164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] RBAC: Adding query filter params (interface=public, service_id=2951bf0a70894afbabf1c81dce67cc88, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:22.721549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.723565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.731277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 445/885] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/endpoints?service_id=2951bf0a70894afbabf1c81dce67cc88&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:22.735481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9e198232-9189-413b-b443-97d2e7bca437 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:22.736700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9e198232-9189-413b-b443-97d2e7bca437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:22.738571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.745674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 441/886] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:22 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:22.750592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12770-2d12-4f99-9841-bf3d3b1ce38c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.755306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.756428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.756969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.757509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.759089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.761994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.772183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 446/887] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/services => generated 1497 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:15:22.773976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e198232-9189-413b-b443-97d2e7bca437 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.786306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e198232-9189-413b-b443-97d2e7bca437 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.791911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.793171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.793665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.794333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.807876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:22.816044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:15:22.818084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 442/888] 10.222.0.11 () {56 vars in 1141 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:22.824833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.836019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174e74-c8cc-46a4-9117-42de03da8896 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.840959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.842329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.842610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.842874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.843665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:22.843967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.845598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.854998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 447/889] 10.222.0.11 () {56 vars in 1136 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:22.861431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.872058 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee280-c4bd-4bec-ab81-071a6e1c06bc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.877101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.878395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.878855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.879326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.892505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.894835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.917084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:22.919072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 443/890] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:22.926053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.940168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289746-3f3e-4ee0-a90c-2bed81de0426 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.945144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.945831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.946109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.946454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.947219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:22.947577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:22.949308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:22.963722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 448/891] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:22.970915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:22.982590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff65c9-407e-4ecc-a7a3-73fd450a38af admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:22.987443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a7c0-fc96-4de8-b6a8-6b22606c3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:22.988319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a7c0-fc96-4de8-b6a8-6b22606c3230 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:22.988632 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a7c0-fc96-4de8-b6a8-6b22606c3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:22.988931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a7c0-fc96-4de8-b6a8-6b22606c3230 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:22.998851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a7c0-fc96-4de8-b6a8-6b22606c3230 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.001315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a7c0-fc96-4de8-b6a8-6b22606c3230 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.016764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c7d1a7c0-fc96-4de8-b6a8-6b22606c3230 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:15:23.018379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 444/892] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:15:22 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:23.024895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.034873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410eef-4bff-49ea-a66c-c509bcb5eceb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.039595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.040255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.040678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.041229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.041803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:23.042209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.044055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.063416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 449/893] 10.222.0.11 () {56 vars in 1170 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:23.065249 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b9318-9998-4639-bd2e-2216a29d55a1 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.065720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b9318-9998-4639-bd2e-2216a29d55a1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.069604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b9318-9998-4639-bd2e-2216a29d55a1 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.069604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 445/894] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:23.070691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.076495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762d33-3d32-4e64-9282-c66046be3085 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.076972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762d33-3d32-4e64-9282-c66046be3085 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.078023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d762d33-3d32-4e64-9282-c66046be3085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.081470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7c1b3-bb61-410c-a9ac-51248c58455e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.086455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.087838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.088121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.088392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.099476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.099934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2d762d33-3d32-4e64-9282-c66046be3085 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:23.101131 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2d762d33-3d32-4e64-9282-c66046be3085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:23.102067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.113037 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 450/895] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/auth/tokens => generated 2138 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:23.114349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 446/896] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:23 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:23.118876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.128575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01311-3765-4d87-b752-7413d0092eb2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.133863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.134961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.135443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.135943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.142509 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d762d33-3d32-4e64-9282-c66046be3085 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.150370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.152537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d762d33-3d32-4e64-9282-c66046be3085 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.152659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.157946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.158869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.159246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.159615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.160386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.162913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.172708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:23.174440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 451/897] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:23.179061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 11 16:15:23.180550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 447/898] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:23.181541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.190762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.192717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472adc0-4afc-4be2-b097-aa1dfbe335a3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.198116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.199024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.199739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.200182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.201220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:23.201671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.202042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686097-a96a-438b-b788-aef2bf706520 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.203614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.207579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.208344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.208724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.209092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.209913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:23.210369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.212528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.218217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 452/899] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:23.223299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 448/900] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:23.224733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.229908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.236446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54985db6-9487-44ad-89d1-b4ddbe144fb9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.240289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e3c1e-4cb8-4fb7-8947-5936d46008d0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.241563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.242838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.243423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.244040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.245159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.245858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.246144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.246805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.248350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:23.248720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.250436 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.254510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.260376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 449/901] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:23.264341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.279942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:23.281838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 453/902] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:23.288050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.299320 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341971c-8a48-486b-8e59-dd8484cb6c9d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.304696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e64c03-d196-4f10-aad7-13354845ab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.305659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64c03-d196-4f10-aad7-13354845ab91 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.306089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64c03-d196-4f10-aad7-13354845ab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.306593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64c03-d196-4f10-aad7-13354845ab91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.307666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e64c03-d196-4f10-aad7-13354845ab91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:23.308125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e64c03-d196-4f10-aad7-13354845ab91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.310860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e64c03-d196-4f10-aad7-13354845ab91 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.325322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 450/903] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:23.332081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:23.344802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efe99-d9d4-4d18-bfef-d36c35610675 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:23.349881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e394250-77c2-4612-a335-d2ac310a0433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:23.350721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394250-77c2-4612-a335-d2ac310a0433 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:23.351104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394250-77c2-4612-a335-d2ac310a0433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:23.351381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394250-77c2-4612-a335-d2ac310a0433 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:23.352264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e394250-77c2-4612-a335-d2ac310a0433 admin admin] RBAC: Adding query filter params (role.id=e35ffe4e61064f628e64df44ac5bdb8c, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=9f7408badb7143c097d6450cb1e2ec8b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:23.352628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e394250-77c2-4612-a335-d2ac310a0433 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:23.354605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e394250-77c2-4612-a335-d2ac310a0433 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:23.362102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 454/904] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:23 2021] GET /identity/v3/role_assignments?user.id=9f7408badb7143c097d6450cb1e2ec8b&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=e35ffe4e61064f628e64df44ac5bdb8c => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:24.794824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef115b-5107-4324-9d0a-39564a93612d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:24.795314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef115b-5107-4324-9d0a-39564a93612d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:24.795314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef115b-5107-4324-9d0a-39564a93612d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:24.797539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 451/905] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:24.803618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3fe9c-e1c0-491a-aa6c-416bdbd167aa None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:24.804029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3fe9c-e1c0-491a-aa6c-416bdbd167aa None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:24.804232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3fe9c-e1c0-491a-aa6c-416bdbd167aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:24.822385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1ac3fe9c-e1c0-491a-aa6c-416bdbd167aa None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:24.823576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1ac3fe9c-e1c0-491a-aa6c-416bdbd167aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:24.831643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 455/906] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:24 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:24.858427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef115b-5107-4324-9d0a-39564a93612d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:24.870891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef115b-5107-4324-9d0a-39564a93612d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:24.875929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:24.876583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:24.876868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:24.877146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:24.877880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:24.879750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:24.881102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.common [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 11 16:15:24.929928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.sql.core [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 11 16:15:24.929928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 11 16:15:24.929928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [parameters: {'id': '3521a7fb2dec4c898add3a02dbdecb15', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 11 16:15:24.929928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79350) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 11 16:15:24.945789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3521a7fb2dec4c898add3a02dbdecb15.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3521a7fb2dec4c898add3a02dbdecb15. Nov 11 16:15:24.947549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 452/907] 10.222.0.11 () {60 vars in 1161 bytes} [Thu Nov 11 16:15:24 2021] POST /identity/v3/projects => generated 262 bytes in 89 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:24.954427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3fe9c-e1c0-491a-aa6c-416bdbd167aa None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:24.963408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3fe9c-e1c0-491a-aa6c-416bdbd167aa None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:24.968720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03c2e6-27d4-49ff-88e6-7301fa1ee1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:24.969692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03c2e6-27d4-49ff-88e6-7301fa1ee1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:24.970027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03c2e6-27d4-49ff-88e6-7301fa1ee1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:24.970404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03c2e6-27d4-49ff-88e6-7301fa1ee1b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:24.978967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03c2e6-27d4-49ff-88e6-7301fa1ee1b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:24.981280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03c2e6-27d4-49ff-88e6-7301fa1ee1b9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:24.996868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ed03c2e6-27d4-49ff-88e6-7301fa1ee1b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:24.998760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 456/908] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:25.005414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.017951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5f9e0-b497-48f7-9a72-826a44f5b1d0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.022720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e177a-b2b4-43bc-b012-9b3eb5a11a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.023375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e177a-b2b4-43bc-b012-9b3eb5a11a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.023714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e177a-b2b4-43bc-b012-9b3eb5a11a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.024003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e177a-b2b4-43bc-b012-9b3eb5a11a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.024781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e177a-b2b4-43bc-b012-9b3eb5a11a2a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:25.025094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e177a-b2b4-43bc-b012-9b3eb5a11a2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.027236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e177a-b2b4-43bc-b012-9b3eb5a11a2a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.053779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 453/909] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:25 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:25.129453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5d7cc-15b6-485b-9481-9fd82a0afa83 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.129736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5d7cc-15b6-485b-9481-9fd82a0afa83 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.130016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5d7cc-15b6-485b-9481-9fd82a0afa83 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.132167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 457/910] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:25.139742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fd43c-94c1-488e-b97c-915682a60059 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.140029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fd43c-94c1-488e-b97c-915682a60059 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.140306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fd43c-94c1-488e-b97c-915682a60059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.159412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-dc4fd43c-94c1-488e-b97c-915682a60059 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:25.160942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dc4fd43c-94c1-488e-b97c-915682a60059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:25.169753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 454/911] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:25 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:25.194068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5d7cc-15b6-485b-9481-9fd82a0afa83 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.208086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5d7cc-15b6-485b-9481-9fd82a0afa83 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.212653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.213465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.213737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.214004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.214729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.216706 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.228711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:15:25.230306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 458/912] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:25.239100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fd43c-94c1-488e-b97c-915682a60059 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.248887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fd43c-94c1-488e-b97c-915682a60059 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.253673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.254426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.254707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.254977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.255779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:25.256086 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.257788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.264545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 455/913] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:25.273693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.281141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24fed1-5c46-490b-a116-72f0e9bc691b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.285736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d991a1-aad4-4e4c-9456-40748c450824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.286417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d991a1-aad4-4e4c-9456-40748c450824 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.286732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d991a1-aad4-4e4c-9456-40748c450824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.287044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d991a1-aad4-4e4c-9456-40748c450824 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.287768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d991a1-aad4-4e4c-9456-40748c450824 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:25.288075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d991a1-aad4-4e4c-9456-40748c450824 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.289657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d991a1-aad4-4e4c-9456-40748c450824 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.296324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 459/914] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:25.303242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.313976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a6d97-fbdd-4b49-90b5-449ea6e89e2a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.318610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db02fe9-663b-477f-9254-8e1c5dd34f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.319271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02fe9-663b-477f-9254-8e1c5dd34f1e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.319555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02fe9-663b-477f-9254-8e1c5dd34f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.319837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db02fe9-663b-477f-9254-8e1c5dd34f1e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.320616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db02fe9-663b-477f-9254-8e1c5dd34f1e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.322308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db02fe9-663b-477f-9254-8e1c5dd34f1e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.394056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 456/915] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:25 2021] POST /identity/v3/endpoints => generated 349 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:25.647138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac041f0-20d0-41b0-87e4-c37a332959a3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.647346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac041f0-20d0-41b0-87e4-c37a332959a3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.647623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac041f0-20d0-41b0-87e4-c37a332959a3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.649662 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 460/916] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:25.656853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076254-c9fc-4af7-aa4f-217a2684dd70 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.657129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076254-c9fc-4af7-aa4f-217a2684dd70 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.657409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076254-c9fc-4af7-aa4f-217a2684dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.676216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bd076254-c9fc-4af7-aa4f-217a2684dd70 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:25.677718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bd076254-c9fc-4af7-aa4f-217a2684dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:25.698298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 457/917] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:25 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:25.719536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac041f0-20d0-41b0-87e4-c37a332959a3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.731993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac041f0-20d0-41b0-87e4-c37a332959a3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.740727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.741381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.741661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.741934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.742721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.744380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.762161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625e817-0a0b-4e61-a33b-b20496349186 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.762483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625e817-0a0b-4e61-a33b-b20496349186 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.762860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625e817-0a0b-4e61-a33b-b20496349186 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.764904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 458/918] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:25.770779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979086-d16c-4f32-8d3b-866aaa9e7b21 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.771068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979086-d16c-4f32-8d3b-866aaa9e7b21 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.771348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979086-d16c-4f32-8d3b-866aaa9e7b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.790042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9e979086-d16c-4f32-8d3b-866aaa9e7b21 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:25.791300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9e979086-d16c-4f32-8d3b-866aaa9e7b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:25.800270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 459/919] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:25 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:25.810426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 461/920] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:25 2021] POST /identity/v3/services => generated 242 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:25.827639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979086-d16c-4f32-8d3b-866aaa9e7b21 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.837855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979086-d16c-4f32-8d3b-866aaa9e7b21 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.854263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.855405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.855853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.856468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.858143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.860033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.872286 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 11 16:15:25.874894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 460/921] 10.222.0.11 () {56 vars in 1126 bytes} [Thu Nov 11 16:15:25 2021] GET /identity/v3/services/image => generated 86 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:25.883651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.896096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84260e81-f063-4cf5-81d4-ef24c586b11d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.901360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45034911-d8df-4797-9943-ae43a47852a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.902425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45034911-d8df-4797-9943-ae43a47852a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.902918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45034911-d8df-4797-9943-ae43a47852a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.904133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45034911-d8df-4797-9943-ae43a47852a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.905737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45034911-d8df-4797-9943-ae43a47852a0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:25.906300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45034911-d8df-4797-9943-ae43a47852a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.908153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45034911-d8df-4797-9943-ae43a47852a0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.914332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 462/922] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:25 2021] GET /identity/v3/services?name=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:25.921559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:25.931990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1326a8-3efd-4c29-a3fb-2ab640f1796f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:25.937801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc2e52-b5c7-484d-8ca2-a851dfd3813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:25.938845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc2e52-b5c7-484d-8ca2-a851dfd3813a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:25.939331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc2e52-b5c7-484d-8ca2-a851dfd3813a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:25.939803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc2e52-b5c7-484d-8ca2-a851dfd3813a admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:25.940774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc2e52-b5c7-484d-8ca2-a851dfd3813a admin admin] RBAC: Adding query filter params (type=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:25.941284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc2e52-b5c7-484d-8ca2-a851dfd3813a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:25.943129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc2e52-b5c7-484d-8ca2-a851dfd3813a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:25.949031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 461/923] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:25 2021] GET /identity/v3/services?type=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:27.458636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31311-8278-4295-ab10-6edd8a153111 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.459156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31311-8278-4295-ab10-6edd8a153111 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.459260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31311-8278-4295-ab10-6edd8a153111 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.461246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 463/924] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:27.467837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673c84-e29f-4765-8142-30508343684c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.468241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673c84-e29f-4765-8142-30508343684c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.468430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673c84-e29f-4765-8142-30508343684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.487489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-08673c84-e29f-4765-8142-30508343684c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:27.489656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-08673c84-e29f-4765-8142-30508343684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:27.504140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 462/925] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:27 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:27.532250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31311-8278-4295-ab10-6edd8a153111 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.550354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f31311-8278-4295-ab10-6edd8a153111 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.554897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.555547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.555828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.556105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.556836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.558928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.560890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.common [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 11 16:15:27.638414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.sql.core [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 11 16:15:27.638414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 11 16:15:27.638414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [parameters: {'user_id': '81343a6c2a174bef81cb32ade9289d12', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 11 16:15:27.638414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 11 16:15:27.644377 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 11 16:15:27.650402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 464/926] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:15:27 2021] POST /identity/v3/users => generated 160 bytes in 114 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:27.652719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673c84-e29f-4765-8142-30508343684c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.663005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673c84-e29f-4765-8142-30508343684c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.667997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f4c06-61cd-4ae9-914e-5914723b194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.670101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4c06-61cd-4ae9-914e-5914723b194c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.670618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4c06-61cd-4ae9-914e-5914723b194c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.671115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4c06-61cd-4ae9-914e-5914723b194c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.679005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f4c06-61cd-4ae9-914e-5914723b194c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.681282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f4c06-61cd-4ae9-914e-5914723b194c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.697059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4e5f4c06-61cd-4ae9-914e-5914723b194c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:15:27.699015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 463/927] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:27.706017 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.718197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d692f-3a73-40b7-aa06-d2d4ba1b5ef9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.722747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.723403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.723683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.723958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.724836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:27.725145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.727329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.748568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9567b9-6980-4172-a6d6-2b721933d613 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.749215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9567b9-6980-4172-a6d6-2b721933d613 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.749726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9567b9-6980-4172-a6d6-2b721933d613 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.752012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 464/928] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:27.757738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5a06-a62a-4acf-95ab-1281fd98c36c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.758330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5a06-a62a-4acf-95ab-1281fd98c36c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.758752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5a06-a62a-4acf-95ab-1281fd98c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.774695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 465/929] 10.222.0.11 () {56 vars in 1122 bytes} [Thu Nov 11 16:15:27 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:27.777146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-108c5a06-a62a-4acf-95ab-1281fd98c36c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:27.778950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-108c5a06-a62a-4acf-95ab-1281fd98c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:27.787357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 465/930] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:27 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:27.813075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.823178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26349777-b38e-4fbf-bab8-1fccfab71d53 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.828593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.829423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.829710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.829985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.830715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.832386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.844965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:15:27.846578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 466/931] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:27.854901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c5a06-a62a-4acf-95ab-1281fd98c36c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.864787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c5a06-a62a-4acf-95ab-1281fd98c36c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.869592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.870315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.870596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.870873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.871613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:27.871980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.873583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.879097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 466/932] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:27.885939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.897188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e3c7-2b09-4474-9e6f-3004f1f6f9e5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.902266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.903000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.904032 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.904032 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.904917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:27.905230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.906962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.913066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 467/933] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:27.920567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.931058 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4d6f2-7e5d-4acb-8516-818cfa7a48e7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.936642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0db8c-fab9-487e-bc22-52213fa78daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.937412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0db8c-fab9-487e-bc22-52213fa78daf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.937694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0db8c-fab9-487e-bc22-52213fa78daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.938015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0db8c-fab9-487e-bc22-52213fa78daf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.938918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0db8c-fab9-487e-bc22-52213fa78daf admin admin] RBAC: Adding query filter params (interface=admin, service_id=2951bf0a70894afbabf1c81dce67cc88, region_id=RegionOne) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:27.939333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0db8c-fab9-487e-bc22-52213fa78daf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.941036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0db8c-fab9-487e-bc22-52213fa78daf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.947348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 467/934] 10.222.0.11 () {56 vars in 1270 bytes} [Thu Nov 11 16:15:27 2021] GET /identity/v3/endpoints?service_id=2951bf0a70894afbabf1c81dce67cc88&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:27.953929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:27.964221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072653e-39f8-40c6-99c3-e983429d485a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:27.969878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deed0b0-1aa6-4682-af4c-7bbe642ba96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:27.970507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed0b0-1aa6-4682-af4c-7bbe642ba96c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:27.970836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed0b0-1aa6-4682-af4c-7bbe642ba96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:27.971111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deed0b0-1aa6-4682-af4c-7bbe642ba96c admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:27.971865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deed0b0-1aa6-4682-af4c-7bbe642ba96c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:27.973548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deed0b0-1aa6-4682-af4c-7bbe642ba96c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:27.980905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 468/935] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:27 2021] GET /identity/v3/services => generated 1727 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:15:28.188254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cb2d-25ec-4403-a26d-3d4194b82ee4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.188600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cb2d-25ec-4403-a26d-3d4194b82ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.188827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cb2d-25ec-4403-a26d-3d4194b82ee4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.190663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 468/936] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:28.196747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf0a2-53d0-408c-95b7-6d7b86a5650f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.197039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf0a2-53d0-408c-95b7-6d7b86a5650f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.197312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf0a2-53d0-408c-95b7-6d7b86a5650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.217489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-566cf0a2-53d0-408c-95b7-6d7b86a5650f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:28.219343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-566cf0a2-53d0-408c-95b7-6d7b86a5650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:28.227550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 469/937] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:28 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:28.253425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5cb2d-25ec-4403-a26d-3d4194b82ee4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:28.266685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5cb2d-25ec-4403-a26d-3d4194b82ee4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:28.271374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:28.272176 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.272460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.272737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.273420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:28.275120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:28.286462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 11 16:15:28.287806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 469/938] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:28.297038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cf0a2-53d0-408c-95b7-6d7b86a5650f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:28.306313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cf0a2-53d0-408c-95b7-6d7b86a5650f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:28.311689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:28.312340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.312621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.312895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.313611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:28.313919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:28.315559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:28.325910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 470/939] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:28.327154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:28.336812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f939-076d-4311-b517-bd591e5b694e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:28.341461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:28.342132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.342449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.345442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.345442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:28.345442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:28.345442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:28.350529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 470/940] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:28 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:28.357411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:28.367417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7e5e2-97c1-45c5-b89a-6c01f84ddb75 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:28.372562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28a1d-9241-492e-9cda-af360c9d1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:28.373313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28a1d-9241-492e-9cda-af360c9d1c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.373596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28a1d-9241-492e-9cda-af360c9d1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.374040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28a1d-9241-492e-9cda-af360c9d1c61 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.374731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde28a1d-9241-492e-9cda-af360c9d1c61 admin admin] RBAC: Adding query filter params (interface=public, service_id=6bae5002b0e34b5b99d6a345a33d22c9, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:28.375048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde28a1d-9241-492e-9cda-af360c9d1c61 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:28.376650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde28a1d-9241-492e-9cda-af360c9d1c61 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:28.382016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 471/941] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:15:28 2021] GET /identity/v3/endpoints?service_id=6bae5002b0e34b5b99d6a345a33d22c9&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:28.388486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:28.398209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480d96-8283-43d7-b215-cce2c05169c7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:28.398340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c88a-8d3e-4acf-b18b-501b4292ed04 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.398561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c88a-8d3e-4acf-b18b-501b4292ed04 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.398849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485c88a-8d3e-4acf-b18b-501b4292ed04 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.400860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 472/942] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:28.407079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:28.407216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036f7a-8a8e-49a2-a5d0-3f355f7783d0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.407483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036f7a-8a8e-49a2-a5d0-3f355f7783d0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.407762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036f7a-8a8e-49a2-a5d0-3f355f7783d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.407852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.411700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.411700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.411700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:28.411700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:28.418606 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 471/943] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:28 2021] GET /identity/v3/services => generated 1727 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:15:28.427957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-87036f7a-8a8e-49a2-a5d0-3f355f7783d0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:28.429191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-87036f7a-8a8e-49a2-a5d0-3f355f7783d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:28.438900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 473/944] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:28 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:28.463654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:28.474908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aaa47-e43c-4f41-93f1-eb971597e21b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:28.479959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7b8cb-7feb-4dad-8e85-96f66de139bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:28.480570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b8cb-7feb-4dad-8e85-96f66de139bb admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:28.480858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b8cb-7feb-4dad-8e85-96f66de139bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:28.481174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b8cb-7feb-4dad-8e85-96f66de139bb admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:28.482133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7b8cb-7feb-4dad-8e85-96f66de139bb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:28.483233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-80c7b8cb-7feb-4dad-8e85-96f66de139bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:28.483233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:15:28.483233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:15:28.484131 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7b8cb-7feb-4dad-8e85-96f66de139bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:28.569609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 472/945] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:28 2021] POST /identity/v3/services => generated 242 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:30.279151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e4a6e-fd92-4525-9541-f95bedb9fd84 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.279692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e4a6e-fd92-4525-9541-f95bedb9fd84 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.279692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e4a6e-fd92-4525-9541-f95bedb9fd84 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.281648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 474/946] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:30.287445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39d213-4854-4dfe-8600-847c1d9effe0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.287855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39d213-4854-4dfe-8600-847c1d9effe0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.288033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39d213-4854-4dfe-8600-847c1d9effe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.305934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7d39d213-4854-4dfe-8600-847c1d9effe0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:30.307156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7d39d213-4854-4dfe-8600-847c1d9effe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:30.324183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 473/947] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:30 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:30.350357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e4a6e-fd92-4525-9541-f95bedb9fd84 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.363092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e4a6e-fd92-4525-9541-f95bedb9fd84 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.367392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.368181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.368461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.368736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.369412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.371059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.383496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:15:30.384879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 475/948] 10.222.0.11 () {56 vars in 1147 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:30.391620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39d213-4854-4dfe-8600-847c1d9effe0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.400603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39d213-4854-4dfe-8600-847c1d9effe0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.405351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.406097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.406490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.406836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.408218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:30.408592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.410288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.415334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 474/949] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:30.422386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.432099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eed1a-39be-4798-8595-422792339b87 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.437279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b409de-c010-4188-9230-ccf6c1b50044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.437933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b409de-c010-4188-9230-ccf6c1b50044 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.438244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b409de-c010-4188-9230-ccf6c1b50044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.438526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b409de-c010-4188-9230-ccf6c1b50044 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.439251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b409de-c010-4188-9230-ccf6c1b50044 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:30.439557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b409de-c010-4188-9230-ccf6c1b50044 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.441142 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b409de-c010-4188-9230-ccf6c1b50044 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.447364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 476/950] 10.222.0.11 () {56 vars in 1143 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:30.452426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.462020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91eb05-81e5-482f-80a8-09a1c9fed75d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.466739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7ae8a-96bc-44e2-976c-b05268091049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.467390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7ae8a-96bc-44e2-976c-b05268091049 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.467673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7ae8a-96bc-44e2-976c-b05268091049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.467949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7ae8a-96bc-44e2-976c-b05268091049 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.468719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7ae8a-96bc-44e2-976c-b05268091049 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.470353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7ae8a-96bc-44e2-976c-b05268091049 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.560543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 475/951] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:30 2021] POST /identity/v3/endpoints => generated 325 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:30.711931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a80-628b-4628-80a4-022973a58570 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.712223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a80-628b-4628-80a4-022973a58570 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.712494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a80-628b-4628-80a4-022973a58570 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.714427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 477/952] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:30.721844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18dbd7-02c2-4e6b-b3da-0d86c882bb52 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.722229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18dbd7-02c2-4e6b-b3da-0d86c882bb52 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.722455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18dbd7-02c2-4e6b-b3da-0d86c882bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.741059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8b18dbd7-02c2-4e6b-b3da-0d86c882bb52 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:30.742301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8b18dbd7-02c2-4e6b-b3da-0d86c882bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:30.760917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 476/953] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:30 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:30.786968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a80-628b-4628-80a4-022973a58570 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.800244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a80-628b-4628-80a4-022973a58570 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.804801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc72c-ea25-48f5-b9cb-60545c8ecbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.805576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc72c-ea25-48f5-b9cb-60545c8ecbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.805860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc72c-ea25-48f5-b9cb-60545c8ecbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.806137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc72c-ea25-48f5-b9cb-60545c8ecbd9 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.806842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc72c-ea25-48f5-b9cb-60545c8ecbd9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.808439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc72c-ea25-48f5-b9cb-60545c8ecbd9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.820160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3b8fc72c-ea25-48f5-b9cb-60545c8ecbd9 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 11 16:15:30.821660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 478/954] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:30.828836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18dbd7-02c2-4e6b-b3da-0d86c882bb52 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.837895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18dbd7-02c2-4e6b-b3da-0d86c882bb52 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.839779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71c8da-a407-4925-b2ba-e50551d28673 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.840057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71c8da-a407-4925-b2ba-e50551d28673 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.840862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71c8da-a407-4925-b2ba-e50551d28673 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.842869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 479/955] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:30.843414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.844106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.844351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.844620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.845354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:30.845665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.847312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.848167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c690-81fa-4374-9f8f-f31af3f8c05c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.848452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c690-81fa-4374-9f8f-f31af3f8c05c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.848727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c690-81fa-4374-9f8f-f31af3f8c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.853155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 477/956] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:30.860169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.867082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-17f5c690-81fa-4374-9f8f-f31af3f8c05c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:30.868243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-17f5c690-81fa-4374-9f8f-f31af3f8c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:30.871198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce24e4-1948-4192-9816-41133b25fbe3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.876120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 480/957] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:30 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:30.876551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.877416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.877982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.878486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.879478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:30.879966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.881728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.887285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 478/958] 10.222.0.11 () {56 vars in 1133 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:30.893655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c690-81fa-4374-9f8f-f31af3f8c05c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.901451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.904092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c690-81fa-4374-9f8f-f31af3f8c05c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.909577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.910254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.910540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.910817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.911581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.911874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade857f-7da6-48cd-ba8b-5291924de109 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.913247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.916325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.917099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.917675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.917675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.918324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.920577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.931371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 11 16:15:30.932538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 479/959] 10.222.0.11 () {56 vars in 1126 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:30.939640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.948952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b82b-9f51-4315-bd03-bab7e9eafff6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.954131 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.954783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.955068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.955346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.956060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] RBAC: Adding query filter params (name=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:30.956363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.957917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.962645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 480/960] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:30.969123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:30.978147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33e8f7-8cda-4e41-8166-83cf3412592b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:30.983028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:30.983647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:30.983924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:30.988866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:30.988866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] RBAC: Adding query filter params (type=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:30.988866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:30.988866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:30.991416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 481/961] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:30.998208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:31.007340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b749f-3a4f-44eb-b179-1dc411b9fb0d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:31.012055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24f919-2fbd-4e2d-a244-86661fd6d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:31.013216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24f919-2fbd-4e2d-a244-86661fd6d753 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:31.013496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24f919-2fbd-4e2d-a244-86661fd6d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:31.021678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24f919-2fbd-4e2d-a244-86661fd6d753 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:31.021678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24f919-2fbd-4e2d-a244-86661fd6d753 admin admin] RBAC: Adding query filter params (interface=public, service_id=7cb25c159da7472494eb86b475538e20, region_id=RegionOne) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:31.021678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24f919-2fbd-4e2d-a244-86661fd6d753 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:31.021943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 481/962] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:30 2021] POST /identity/v3/endpoints => generated 334 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:31.022064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24f919-2fbd-4e2d-a244-86661fd6d753 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:31.022064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 482/963] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:15:30 2021] GET /identity/v3/endpoints?service_id=7cb25c159da7472494eb86b475538e20&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:31.033802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:31.055865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07b3c3-a14a-4650-8a1b-0e6fec8308c8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:31.062071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbedc8-64a0-4bb5-82b2-564fc1cf7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:31.062867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbedc8-64a0-4bb5-82b2-564fc1cf7fac admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:31.063214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbedc8-64a0-4bb5-82b2-564fc1cf7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:31.063556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbedc8-64a0-4bb5-82b2-564fc1cf7fac admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:31.064337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbedc8-64a0-4bb5-82b2-564fc1cf7fac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:31.066036 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbedc8-64a0-4bb5-82b2-564fc1cf7fac admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:31.073615 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 482/964] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:15:31 2021] GET /identity/v3/services => generated 1957 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:15:32.881788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a1c14-424c-4a1a-a4f0-09c8676849e0 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:32.882737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a1c14-424c-4a1a-a4f0-09c8676849e0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:32.882737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a1c14-424c-4a1a-a4f0-09c8676849e0 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:32.884488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 483/965] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:32.890937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afba9-a7d5-42a8-be06-2543129ad027 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:32.891356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afba9-a7d5-42a8-be06-2543129ad027 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:32.891500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afba9-a7d5-42a8-be06-2543129ad027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:32.909582 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-556afba9-a7d5-42a8-be06-2543129ad027 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:32.910796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-556afba9-a7d5-42a8-be06-2543129ad027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:32.918661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 483/966] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:32 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:32.944825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a1c14-424c-4a1a-a4f0-09c8676849e0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:32.957597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a1c14-424c-4a1a-a4f0-09c8676849e0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:32.961945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a05e-caf3-4b61-950b-48fceee8e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:32.962744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a05e-caf3-4b61-950b-48fceee8e3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:32.963024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a05e-caf3-4b61-950b-48fceee8e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:32.963294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a05e-caf3-4b61-950b-48fceee8e3d6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:32.964470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96a05e-caf3-4b61-950b-48fceee8e3d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:32.966325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96a05e-caf3-4b61-950b-48fceee8e3d6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:32.968063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 484/967] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:32.974364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afba9-a7d5-42a8-be06-2543129ad027 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:32.983756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afba9-a7d5-42a8-be06-2543129ad027 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:32.988230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096346ee-8503-48bd-abce-37fda84261ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:32.988870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096346ee-8503-48bd-abce-37fda84261ca admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:32.989145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096346ee-8503-48bd-abce-37fda84261ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:32.989413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096346ee-8503-48bd-abce-37fda84261ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:32.990139 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096346ee-8503-48bd-abce-37fda84261ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:32.992045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096346ee-8503-48bd-abce-37fda84261ca admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.073789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 484/968] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:32 2021] POST /identity/v3/projects => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:33.423972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c7e81-fa41-4924-873f-2b369a1ae436 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.424373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c7e81-fa41-4924-873f-2b369a1ae436 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.424653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c7e81-fa41-4924-873f-2b369a1ae436 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.426526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 485/969] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:33.432474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a996b4-29fa-44ff-b338-7ce86f640b2f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.432767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a996b4-29fa-44ff-b338-7ce86f640b2f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.433047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a996b4-29fa-44ff-b338-7ce86f640b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.447317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba0d4-b453-4f59-baa1-dfd0dd0c7366 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.447604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba0d4-b453-4f59-baa1-dfd0dd0c7366 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.447886 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba0d4-b453-4f59-baa1-dfd0dd0c7366 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.450243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 486/970] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:15:33.455400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-64a996b4-29fa-44ff-b338-7ce86f640b2f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:33.456595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-64a996b4-29fa-44ff-b338-7ce86f640b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:33.456785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f54f-5e60-459f-ab6d-16bb2d10b48a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.457064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f54f-5e60-459f-ab6d-16bb2d10b48a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.457347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f54f-5e60-459f-ab6d-16bb2d10b48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.475459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d0e7f54f-5e60-459f-ab6d-16bb2d10b48a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:33.476649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d0e7f54f-5e60-459f-ab6d-16bb2d10b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:33.515700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 485/971] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:33 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:33.543836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 487/972] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:33 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:15:33.551385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a996b4-29fa-44ff-b338-7ce86f640b2f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.566024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a996b4-29fa-44ff-b338-7ce86f640b2f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.570580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f54f-5e60-459f-ab6d-16bb2d10b48a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.570788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.571515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.571803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.572072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.580438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f54f-5e60-459f-ab6d-16bb2d10b48a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.583418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:33.585796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.586821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.587290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.587747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.588601 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.590538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.592104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:15:33.593290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 486/973] 10.222.0.11 () {56 vars in 1141 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:33.599632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.602333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 11 16:15:33.603846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 488/974] 10.222.0.11 () {56 vars in 1126 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:33.610595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.613475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dc483-734b-4afe-814f-831c2ba0fbac admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.618060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.618723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.619005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.619272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.620044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:33.620337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.620500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59b49a-95e0-4bf0-a6a9-c8e914934ff3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.623276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.625654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.626331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.626620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.626900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.627646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] RBAC: Adding query filter params (name=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:33.627958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.629514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.635069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 489/975] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:33.638349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 487/976] 10.222.0.11 () {56 vars in 1136 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:33.642929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.643078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.652401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d24c9-a8b4-456d-9cf5-1110e7b8e5be admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.652558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a9e58-62b4-4980-8075-b3dd4eadad30 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.657171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.657326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.657961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.658281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.658448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.658551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.658965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.659378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.660241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] RBAC: Adding query filter params (type=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:33.660693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.662424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.668694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 490/977] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:33.669522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.671721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.675144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.685301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77374e8d-62db-4a57-987c-f92a9e969f9e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.689743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.690138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:33.690391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.690676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.690948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.696646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 488/978] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:33.696781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.696781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.698256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.707916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad211b-8248-42fd-a499-cb1a0ef2b01a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.712394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.713004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.713288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.713561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.714329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:33.728027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.728027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.728423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 489/979] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:33.735447 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.744510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30573903-d87e-4b3e-86e2-404642367b82 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.749576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.750361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.750642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.750920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.758869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.765436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.773711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:15:33.782046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 490/980] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:15:33.783263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.792489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adeec8-e95f-425e-a50f-18d033272bfd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.793113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 491/981] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:15:33 2021] POST /identity/v3/endpoints => generated 327 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:33.810601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.811297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.811582 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.811857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.812737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:33.813050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.816216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.846547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 491/982] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:33.848855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.862350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24154d1-2f62-4386-86d0-d3250c47ad94 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.867214 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.867882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.868170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.868451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.878008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.879974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.891599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 492/983] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:33.897979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.909217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aebe9-8902-4af0-9da4-5e856b0cf31a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.914122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.914968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.915252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.915526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.928459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.930294 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.950918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:33.954400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 492/984] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:33.959059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:33.969297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006564b6-564a-4884-858f-55cdc5f611c3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:33.974293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:33.975075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:33.975437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:33.975788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:33.976675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:33.977056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:33.978787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:33.994090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 493/985] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:34.000404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:34.010675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1afa4b-9729-4896-bc2f-a5432624072d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:34.016220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:34.017247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:34.017540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:34.017812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:34.025375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:34.027445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:34.045426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:34.046888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 493/986] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:34.053190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:34.063558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2867d7-c3b4-49a0-bd96-859147e7701b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:34.068080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743d93-3435-44d6-bd2a-9bba45a6c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:34.068732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743d93-3435-44d6-bd2a-9bba45a6c986 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:34.069020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743d93-3435-44d6-bd2a-9bba45a6c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:34.069300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743d93-3435-44d6-bd2a-9bba45a6c986 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:34.070109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743d93-3435-44d6-bd2a-9bba45a6c986 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:34.070516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743d93-3435-44d6-bd2a-9bba45a6c986 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:34.072408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743d93-3435-44d6-bd2a-9bba45a6c986 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:34.084684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 494/987] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:34.091928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:34.102298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1045ab-4ef5-4116-9ba9-412494ac8282 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:34.107020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f94e4d-2899-4ac4-8422-0ca034cd982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:34.107707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94e4d-2899-4ac4-8422-0ca034cd982c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:34.107991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94e4d-2899-4ac4-8422-0ca034cd982c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:34.108269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f94e4d-2899-4ac4-8422-0ca034cd982c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:34.109145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f94e4d-2899-4ac4-8422-0ca034cd982c admin admin] RBAC: Adding query filter params (role.id=e35ffe4e61064f628e64df44ac5bdb8c, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=3cb1d1929f8b40efa72d290b23c8f1e4) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:34.109457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f94e4d-2899-4ac4-8422-0ca034cd982c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:34.111310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f94e4d-2899-4ac4-8422-0ca034cd982c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:34.116693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 494/988] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:34 2021] GET /identity/v3/role_assignments?user.id=3cb1d1929f8b40efa72d290b23c8f1e4&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=e35ffe4e61064f628e64df44ac5bdb8c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:35.400555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a65e9-ce86-4f19-a57d-449dd79b7a5c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:35.401113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a65e9-ce86-4f19-a57d-449dd79b7a5c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:35.401113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a65e9-ce86-4f19-a57d-449dd79b7a5c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:35.403905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 495/989] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:35.409678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4bdfd-1b51-4b30-8037-81db8c77f4d3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:35.410088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4bdfd-1b51-4b30-8037-81db8c77f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:35.410299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4bdfd-1b51-4b30-8037-81db8c77f4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:35.427718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-efd4bdfd-1b51-4b30-8037-81db8c77f4d3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:35.428892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-efd4bdfd-1b51-4b30-8037-81db8c77f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:35.437280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 495/990] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:35.464738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a65e9-ce86-4f19-a57d-449dd79b7a5c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:35.477148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a65e9-ce86-4f19-a57d-449dd79b7a5c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:35.481832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2d45-d6d5-4c7d-a606-8e90707cb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:35.482638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2d45-d6d5-4c7d-a606-8e90707cb80a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:35.482921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2d45-d6d5-4c7d-a606-8e90707cb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:35.483195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2d45-d6d5-4c7d-a606-8e90707cb80a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:35.484374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f2d45-d6d5-4c7d-a606-8e90707cb80a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:35.486051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f2d45-d6d5-4c7d-a606-8e90707cb80a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:35.488053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 496/991] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:35.493863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4bdfd-1b51-4b30-8037-81db8c77f4d3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:35.503339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4bdfd-1b51-4b30-8037-81db8c77f4d3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:35.508029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca986bf-b4ad-473f-a2d1-5f8535e0639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:35.508677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca986bf-b4ad-473f-a2d1-5f8535e0639f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:35.508957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca986bf-b4ad-473f-a2d1-5f8535e0639f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:35.509230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca986bf-b4ad-473f-a2d1-5f8535e0639f admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:35.509961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca986bf-b4ad-473f-a2d1-5f8535e0639f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:35.512443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca986bf-b4ad-473f-a2d1-5f8535e0639f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:35.608164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 496/992] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:15:35 2021] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:36.124454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b677fe-104e-4d08-89ea-07d8b9c253e3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.124850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b677fe-104e-4d08-89ea-07d8b9c253e3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.125038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b677fe-104e-4d08-89ea-07d8b9c253e3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.127001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 497/993] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:36.132896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b5fb-6249-4111-8527-1ea347a835ad None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.133268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b5fb-6249-4111-8527-1ea347a835ad None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.133616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b5fb-6249-4111-8527-1ea347a835ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.151736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3580b5fb-6249-4111-8527-1ea347a835ad None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:36.153224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3580b5fb-6249-4111-8527-1ea347a835ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:36.161028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 497/994] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:36.184973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b677fe-104e-4d08-89ea-07d8b9c253e3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.197327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b677fe-104e-4d08-89ea-07d8b9c253e3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.202619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e347f73-111f-47cb-8ae2-ad075d4587fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.203247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347f73-111f-47cb-8ae2-ad075d4587fc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.203528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347f73-111f-47cb-8ae2-ad075d4587fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.203823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e347f73-111f-47cb-8ae2-ad075d4587fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.211663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e347f73-111f-47cb-8ae2-ad075d4587fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.213399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e347f73-111f-47cb-8ae2-ad075d4587fc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.222381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 498/995] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:36.230328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b5fb-6249-4111-8527-1ea347a835ad None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.239926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b5fb-6249-4111-8527-1ea347a835ad None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.244776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e03bca-71fc-418b-a0ef-5730a1e643d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.245705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03bca-71fc-418b-a0ef-5730a1e643d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.246664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03bca-71fc-418b-a0ef-5730a1e643d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.247026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03bca-71fc-418b-a0ef-5730a1e643d4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.248649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e03bca-71fc-418b-a0ef-5730a1e643d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.250634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e03bca-71fc-418b-a0ef-5730a1e643d4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.252595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 498/996] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:36.401831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9788c-b34b-4409-a8bf-d23b8bf7ef1d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.402468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9788c-b34b-4409-a8bf-d23b8bf7ef1d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.402555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9788c-b34b-4409-a8bf-d23b8bf7ef1d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.404635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 499/997] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:36.411027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4af5-751c-4dad-b87c-26b813ec0f68 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.411558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4af5-751c-4dad-b87c-26b813ec0f68 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.411558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4af5-751c-4dad-b87c-26b813ec0f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.431757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e1bc4af5-751c-4dad-b87c-26b813ec0f68 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:36.432959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e1bc4af5-751c-4dad-b87c-26b813ec0f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:36.441997 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 499/998] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:36.466063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9788c-b34b-4409-a8bf-d23b8bf7ef1d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.478685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9788c-b34b-4409-a8bf-d23b8bf7ef1d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.483591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.484388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.484668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.484939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.495895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:36.504106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:15:36.505343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 500/999] 10.222.0.11 () {56 vars in 1141 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:36.513894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4af5-751c-4dad-b87c-26b813ec0f68 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.523147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4af5-751c-4dad-b87c-26b813ec0f68 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.527773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.528421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.528703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.528975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.529745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:36.530043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.531704 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.544397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 500/1000] 10.222.0.11 () {56 vars in 1136 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:36.550736 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.562068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265b462-45c4-48bd-a1c5-7913d54b24ee admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.567596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.568718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.569004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.569286 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.581187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.583088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.601319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:36.602732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 501/1001] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:36.609118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.618916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212333be-ee8d-4d0b-a2bf-078e1b06763f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.623456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.624093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.624375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.624650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.625385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:36.625695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.627312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.640606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 501/1002] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:36.646594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.657354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931edbf1-3b10-4fa8-a63a-c81ddd15c169 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.661723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.662528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.662809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.663083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.670770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.672774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.687031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:15:36.693243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 502/1003] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:36.694355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.705019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044fc3-d4d5-4ba2-b00f-bc86c9a92d1a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.709636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.710322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.710610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.710890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.711744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:36.712055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.713878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.735978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 502/1004] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:36.737892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.747531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac229ec-2221-4eb6-b6d1-2e4ecc86caf4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.751975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.752747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.753025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.753295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.765015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.766875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.784248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:36.785446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 503/1005] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:36.791812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.801862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d82929-7dd0-45de-81da-01caaba61846 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.806338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.806984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.807269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.807547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.808289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:36.809232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.810954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.821988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 503/1006] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:36.828411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.837942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fa4a4-dd31-4cb0-b460-d3943f1ec1db admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.843223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.843996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.844282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.844554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.851280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.853223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.866959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:36.868250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 504/1007] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:36.875060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.884973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec4f8-a1d3-4c94-8d08-c35ac7bd9263 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.889540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bb861-d948-4035-a924-ce6f70370e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.890206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb861-d948-4035-a924-ce6f70370e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.890485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb861-d948-4035-a924-ce6f70370e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.890758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bb861-d948-4035-a924-ce6f70370e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.891554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bb861-d948-4035-a924-ce6f70370e1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:36.891861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bb861-d948-4035-a924-ce6f70370e1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.893686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bb861-d948-4035-a924-ce6f70370e1f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:36.905880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 504/1008] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:36.912608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:36.923973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d2a54-7f15-4641-85e1-0362d2cf2030 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:36.928499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85b3bc-2075-4fa0-9aaa-91d202c97df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:36.929359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85b3bc-2075-4fa0-9aaa-91d202c97df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:36.929639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85b3bc-2075-4fa0-9aaa-91d202c97df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:36.929912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85b3bc-2075-4fa0-9aaa-91d202c97df4 admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/3cb1d1929f8b40efa72d290b23c8f1e4/roles/e35ffe4e61064f628e64df44ac5bdb8c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:36.932156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85b3bc-2075-4fa0-9aaa-91d202c97df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=3cb1d1929f8b40efa72d290b23c8f1e4, role_id=e35ffe4e61064f628e64df44ac5bdb8c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:36.935377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85b3bc-2075-4fa0-9aaa-91d202c97df4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:37.006932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 505/1009] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:15:36 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/3cb1d1929f8b40efa72d290b23c8f1e4/roles/e35ffe4e61064f628e64df44ac5bdb8c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:15:37.965702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882931-38b5-4f3e-aa50-a05e6b532cbd None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:37.966268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882931-38b5-4f3e-aa50-a05e6b532cbd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:37.966360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882931-38b5-4f3e-aa50-a05e6b532cbd None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:37.968075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 505/1010] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:37.975216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577792c-ef06-4765-8e24-c89e533f1344 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:37.975639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577792c-ef06-4765-8e24-c89e533f1344 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:37.975778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577792c-ef06-4765-8e24-c89e533f1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:37.993964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6577792c-ef06-4765-8e24-c89e533f1344 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:37.995173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6577792c-ef06-4765-8e24-c89e533f1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:38.051422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 506/1011] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:38.078200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882931-38b5-4f3e-aa50-a05e6b532cbd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:38.090487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882931-38b5-4f3e-aa50-a05e6b532cbd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:38.094860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:38.095633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:38.095919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:38.096192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:38.106984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:38.113771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:38.115139 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 506/1012] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:38.122506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577792c-ef06-4765-8e24-c89e533f1344 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:38.131557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577792c-ef06-4765-8e24-c89e533f1344 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:38.136361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:38.137146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:38.137432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:38.137713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:38.138518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:38.138830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:38.140419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:38.148726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 507/1013] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:38.155192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:38.165186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5ba9e-078f-40e2-9464-2171b6947ab6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:38.170366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:38.171196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:38.171470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:38.171737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] PATH_INFO: `/v3/users/f90ba6d748104478b8a08f484ba3b3d4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:38.185122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] RBAC: Authorizing `identity:get_user(user_id=f90ba6d748104478b8a08f484ba3b3d4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:38.187283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:38.188895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 507/1014] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:38 2021] GET /identity/v3/users/f90ba6d748104478b8a08f484ba3b3d4 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:38.195370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:38.206041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74b90-56f0-43e3-acc1-9da4546cf87a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:38.210738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:38.211396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:38.211681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:38.211956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:38.221139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:38.222849 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:38.232187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 508/1015] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:38.238886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:38.248486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0108b66-8e2f-4e6f-b735-5ddf979c6b39 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:38.252935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43b78-3171-4a08-b336-8d3d8268cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:38.253764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43b78-3171-4a08-b336-8d3d8268cd93 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:38.254043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43b78-3171-4a08-b336-8d3d8268cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:38.254351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43b78-3171-4a08-b336-8d3d8268cd93 admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:38.255520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43b78-3171-4a08-b336-8d3d8268cd93 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d87ad2ecf9a4de28370ec953d3fab63)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:38.257829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43b78-3171-4a08-b336-8d3d8268cd93 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:38.264760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 508/1016] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:15:38 2021] GET /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:38.265902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:38.274824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523a2a9-90b3-420e-b7f0-800c4ca21b12 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:38.280342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561846b-9453-4cbd-aa1c-c9ef4176a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:38.280982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561846b-9453-4cbd-aa1c-c9ef4176a44d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:38.281267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561846b-9453-4cbd-aa1c-c9ef4176a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:38.281545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561846b-9453-4cbd-aa1c-c9ef4176a44d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:38.282425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561846b-9453-4cbd-aa1c-c9ef4176a44d admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63, user.id=f90ba6d748104478b8a08f484ba3b3d4) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:38.282739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561846b-9453-4cbd-aa1c-c9ef4176a44d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:38.284559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561846b-9453-4cbd-aa1c-c9ef4176a44d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:38.289969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 509/1017] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:38 2021] GET /identity/v3/role_assignments?user.id=f90ba6d748104478b8a08f484ba3b3d4&scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:39.284319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde61fd-3d5b-44f9-be38-7cb4b2d859e1 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.284852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde61fd-3d5b-44f9-be38-7cb4b2d859e1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.284852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde61fd-3d5b-44f9-be38-7cb4b2d859e1 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.286701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 509/1018] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:39.293478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5a2a-4689-4e1f-b56e-faa3b3c57f08 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.295763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5a2a-4689-4e1f-b56e-faa3b3c57f08 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.295763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5a2a-4689-4e1f-b56e-faa3b3c57f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.311146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b43d5a2a-4689-4e1f-b56e-faa3b3c57f08 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:39.312313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b43d5a2a-4689-4e1f-b56e-faa3b3c57f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:39.319951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 510/1019] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:39.346720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde61fd-3d5b-44f9-be38-7cb4b2d859e1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.359274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde61fd-3d5b-44f9-be38-7cb4b2d859e1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.363596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.364386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.364670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.364943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.375557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:39.383113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:15:39.384454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 510/1020] 10.222.0.11 () {56 vars in 1141 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:39.391479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5a2a-4689-4e1f-b56e-faa3b3c57f08 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.400298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5a2a-4689-4e1f-b56e-faa3b3c57f08 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.405544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.406296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.406643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.406982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.407811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:39.408183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.409815 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.423587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 511/1021] 10.222.0.11 () {56 vars in 1136 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:39.425144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.435547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c81d67-77c8-4922-8962-3483303d553f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.439980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.440736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.441016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.441288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.453074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.454979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.472769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:39.473978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 511/1022] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:39.480688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.490125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5e95-e11c-445b-83ff-1c637152498f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.494547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.495185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.495464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.495738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.496489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:39.496788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.498367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.516552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 512/1023] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:39.518007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.528356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf86dc-d2dc-4a9c-9270-6b2a93b8f22a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.532893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.533673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.533960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.534271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.544496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.546624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.560848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:15:39.562029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 512/1024] 10.222.0.11 () {56 vars in 1114 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:39.574997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.586521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a887bdc-2940-4060-9c7e-b05488d7d5b1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.592095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.592752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.593035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.593314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.594168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:39.594503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.596330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.614172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 513/1025] 10.222.0.11 () {56 vars in 1154 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:39.621593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.632500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43b9ff-07ee-4d57-a41f-ab5ef37f8919 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.637803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.638463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.638747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.639022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.646946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.648691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.658281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 513/1026] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:39.664828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.674322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd12d56-ede1-4165-a100-b85d918fee5f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.678716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.679490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.679774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.680048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.690496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.692336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.708969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:15:39.710101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 514/1027] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:39.716482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.725122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ca89-052b-429c-a0b8-2bf20393a3ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.729629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.730354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.730612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.730970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.731713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:39.732022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.733607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.744514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 514/1028] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:39.751057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.760642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea2824-9fa6-4305-948b-2563077ebf16 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.765630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.766410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.766693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.766968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.773639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.775594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.788460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:15:39.789528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 515/1029] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:39.796341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.806984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f69c31-2130-484b-8fdf-71c6f1709ab4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.812080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbff72f-4ebd-4aeb-b442-0210f6634eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.812726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff72f-4ebd-4aeb-b442-0210f6634eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.813009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff72f-4ebd-4aeb-b442-0210f6634eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.813287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbff72f-4ebd-4aeb-b442-0210f6634eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.814088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbff72f-4ebd-4aeb-b442-0210f6634eb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:39.814429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbff72f-4ebd-4aeb-b442-0210f6634eb0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.816254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbff72f-4ebd-4aeb-b442-0210f6634eb0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.828869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 515/1030] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:39.835517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:39.846672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c51d94-72da-41a8-9344-701e0e30c3dd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:39.851081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71684a2-3696-4334-b1ca-5d0952f821bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:39.851707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71684a2-3696-4334-b1ca-5d0952f821bf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:39.851989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71684a2-3696-4334-b1ca-5d0952f821bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:39.852263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71684a2-3696-4334-b1ca-5d0952f821bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:39.853101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71684a2-3696-4334-b1ca-5d0952f821bf admin admin] RBAC: Adding query filter params (role.id=e35ffe4e61064f628e64df44ac5bdb8c, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=3cb1d1929f8b40efa72d290b23c8f1e4) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:39.853412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71684a2-3696-4334-b1ca-5d0952f821bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:39.855381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71684a2-3696-4334-b1ca-5d0952f821bf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:39.860960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 516/1031] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:39 2021] GET /identity/v3/role_assignments?user.id=3cb1d1929f8b40efa72d290b23c8f1e4&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=e35ffe4e61064f628e64df44ac5bdb8c => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:40.555920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c494-68be-40ff-bb42-92e25f9b3ea4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:40.556430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c494-68be-40ff-bb42-92e25f9b3ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:40.556506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31c494-68be-40ff-bb42-92e25f9b3ea4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:40.558263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 516/1032] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:40.564444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051c810-9408-4d3c-b83c-16b27c1d8595 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:40.564860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051c810-9408-4d3c-b83c-16b27c1d8595 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:40.565006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051c810-9408-4d3c-b83c-16b27c1d8595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:40.583219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a051c810-9408-4d3c-b83c-16b27c1d8595 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:40.584407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a051c810-9408-4d3c-b83c-16b27c1d8595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:40.592723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 517/1033] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:40.617747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31c494-68be-40ff-bb42-92e25f9b3ea4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:40.630047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31c494-68be-40ff-bb42-92e25f9b3ea4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:40.634634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:40.635403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:40.635682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:40.635952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:40.646535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:40.653910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:40.655119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 517/1034] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:40.663180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051c810-9408-4d3c-b83c-16b27c1d8595 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:40.672924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051c810-9408-4d3c-b83c-16b27c1d8595 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:40.677607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:40.678301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:40.678586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:40.678862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:40.679645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:40.679952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:40.681534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:40.690409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 518/1035] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:40.696914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:40.707617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a5c2-1b8b-4978-b44a-6bef71a7e53d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:40.712223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:40.713060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:40.713344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:40.713617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] PATH_INFO: `/v3/users/f90ba6d748104478b8a08f484ba3b3d4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:40.715392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] RBAC: Authorizing `identity:get_user(user_id=f90ba6d748104478b8a08f484ba3b3d4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:40.717516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:40.719134 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 518/1036] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:40 2021] GET /identity/v3/users/f90ba6d748104478b8a08f484ba3b3d4 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:40.725649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:40.735878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267458-d8ec-4ae6-8653-65ba938c1fb5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:40.740346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aab8f4-eabf-41f0-98a5-12e7bcab8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:40.741183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab8f4-eabf-41f0-98a5-12e7bcab8173 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:40.741467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab8f4-eabf-41f0-98a5-12e7bcab8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:40.741748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab8f4-eabf-41f0-98a5-12e7bcab8173 admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:40.742961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aab8f4-eabf-41f0-98a5-12e7bcab8173 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d87ad2ecf9a4de28370ec953d3fab63)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:40.744984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aab8f4-eabf-41f0-98a5-12e7bcab8173 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:40.746835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 519/1037] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:15:40 2021] GET /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:40.753087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:40.762847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557665-ef62-4827-bd84-f17089fac217 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:40.767259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbff9d-77b2-46dd-87fc-f5afe362bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:40.768099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbff9d-77b2-46dd-87fc-f5afe362bccd admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:40.768376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbff9d-77b2-46dd-87fc-f5afe362bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:40.768646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbff9d-77b2-46dd-87fc-f5afe362bccd admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63/users/f90ba6d748104478b8a08f484ba3b3d4/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:40.770613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbff9d-77b2-46dd-87fc-f5afe362bccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d87ad2ecf9a4de28370ec953d3fab63, user_id=f90ba6d748104478b8a08f484ba3b3d4, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:40.773184 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbff9d-77b2-46dd-87fc-f5afe362bccd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:40.859842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 519/1038] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:15:40 2021] PUT /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63/users/f90ba6d748104478b8a08f484ba3b3d4/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:15:43.063115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92ba76-f1b0-4e07-81c6-85e9b219fe97 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.063678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92ba76-f1b0-4e07-81c6-85e9b219fe97 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.063678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92ba76-f1b0-4e07-81c6-85e9b219fe97 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.065423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 520/1039] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:43.071297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcc5a8-f8df-4528-aa11-a56b10f3373d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.071733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcc5a8-f8df-4528-aa11-a56b10f3373d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.071910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcc5a8-f8df-4528-aa11-a56b10f3373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.091001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c8bcc5a8-f8df-4528-aa11-a56b10f3373d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:43.092185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c8bcc5a8-f8df-4528-aa11-a56b10f3373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:43.146007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 520/1040] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:43.172180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92ba76-f1b0-4e07-81c6-85e9b219fe97 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:43.184200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92ba76-f1b0-4e07-81c6-85e9b219fe97 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:43.188451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:43.189208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.189490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.189764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.200116 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:15:43.206803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:15:43.207926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 521/1041] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:15:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:15:43.215353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcc5a8-f8df-4528-aa11-a56b10f3373d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:43.223937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcc5a8-f8df-4528-aa11-a56b10f3373d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:43.228442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:43.229087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.229373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.229653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.230460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:43.230766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:43.232362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:43.240319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 521/1042] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:15:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:43.246775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:43.256855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84463c-82f9-468b-a1a8-bc41db1d6a36 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:43.262302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:43.263134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.263416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.263691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] PATH_INFO: `/v3/users/f90ba6d748104478b8a08f484ba3b3d4` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.264957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] RBAC: Authorizing `identity:get_user(user_id=f90ba6d748104478b8a08f484ba3b3d4)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:43.267095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:43.268649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 522/1043] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:43 2021] GET /identity/v3/users/f90ba6d748104478b8a08f484ba3b3d4 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:43.275176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:43.285846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706ec75-6972-403b-be0a-8ae84c3a67f0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:43.290357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:43.292933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.292933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.292933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.299005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:43.300722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:43.309486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 522/1044] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:43.316119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:43.325979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3079aa-1ef2-4257-9635-69a380ecba55 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:43.330461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfe13e-4149-46d6-9c9f-34a2f18c5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:43.335113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe13e-4149-46d6-9c9f-34a2f18c5b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.335113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe13e-4149-46d6-9c9f-34a2f18c5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.335113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe13e-4149-46d6-9c9f-34a2f18c5b91 admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.335113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfe13e-4149-46d6-9c9f-34a2f18c5b91 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d87ad2ecf9a4de28370ec953d3fab63)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:43.335113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfe13e-4149-46d6-9c9f-34a2f18c5b91 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:43.336648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 523/1045] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:15:43 2021] GET /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:43.343921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:43.352376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ae7e-bbb4-4804-9e4a-9c654faa18ad admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:43.356960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90557b60-1965-4e61-b165-3f898f79eeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:43.357564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90557b60-1965-4e61-b165-3f898f79eeff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:43.360235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90557b60-1965-4e61-b165-3f898f79eeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:43.360235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90557b60-1965-4e61-b165-3f898f79eeff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:43.360235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90557b60-1965-4e61-b165-3f898f79eeff admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63, user.id=f90ba6d748104478b8a08f484ba3b3d4) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:43.360235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90557b60-1965-4e61-b165-3f898f79eeff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:43.361007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90557b60-1965-4e61-b165-3f898f79eeff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:43.366524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 523/1046] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:43 2021] GET /identity/v3/role_assignments?user.id=f90ba6d748104478b8a08f484ba3b3d4&scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:45.643164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f04ba-455e-4dca-80ab-f89638c4424c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:45.643738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f04ba-455e-4dca-80ab-f89638c4424c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:45.643738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f04ba-455e-4dca-80ab-f89638c4424c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:45.645475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 524/1047] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:45.651576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40032-2171-4973-97b2-aceac9c3d46d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:45.653079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40032-2171-4973-97b2-aceac9c3d46d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:45.653079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b40032-2171-4973-97b2-aceac9c3d46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:45.670777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-05b40032-2171-4973-97b2-aceac9c3d46d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:45.671967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-05b40032-2171-4973-97b2-aceac9c3d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:45.679556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 524/1048] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:45.707826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f04ba-455e-4dca-80ab-f89638c4424c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:45.719660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f04ba-455e-4dca-80ab-f89638c4424c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:45.723910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4dc74-8d06-4791-aad8-a2cb6a83d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:45.724676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4dc74-8d06-4791-aad8-a2cb6a83d8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:45.724956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4dc74-8d06-4791-aad8-a2cb6a83d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:45.725234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4dc74-8d06-4791-aad8-a2cb6a83d8ab admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:45.726430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4dc74-8d06-4791-aad8-a2cb6a83d8ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:45.728125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4dc74-8d06-4791-aad8-a2cb6a83d8ab admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:45.729675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 525/1049] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:45.735756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40032-2171-4973-97b2-aceac9c3d46d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:45.744443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b40032-2171-4973-97b2-aceac9c3d46d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:45.749491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81022551-1466-4cb8-b496-4c235d08cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:45.750131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81022551-1466-4cb8-b496-4c235d08cb07 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:45.750445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81022551-1466-4cb8-b496-4c235d08cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:45.750724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81022551-1466-4cb8-b496-4c235d08cb07 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:45.751452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81022551-1466-4cb8-b496-4c235d08cb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:45.753343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81022551-1466-4cb8-b496-4c235d08cb07 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:45.865324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 525/1050] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:15:45 2021] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:15:48.142568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a4a03-da9d-4e05-ae14-645452648344 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:48.143092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a4a03-da9d-4e05-ae14-645452648344 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:48.143211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a4a03-da9d-4e05-ae14-645452648344 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:48.144896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 526/1051] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:48.151019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6627-d5ef-4dac-8340-c1faadf8ff7c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:48.151428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6627-d5ef-4dac-8340-c1faadf8ff7c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:48.151714 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d6627-d5ef-4dac-8340-c1faadf8ff7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:48.168772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a85d6627-d5ef-4dac-8340-c1faadf8ff7c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:48.169954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a85d6627-d5ef-4dac-8340-c1faadf8ff7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:48.177474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 526/1052] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:48.204837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a4a03-da9d-4e05-ae14-645452648344 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:48.216871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a4a03-da9d-4e05-ae14-645452648344 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:48.221182 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:48.222005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:48.222334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:48.222614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] PATH_INFO: `/v3/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:48.224104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] RBAC: Authorizing `identity:get_role(role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:48.225100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:48.225100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:15:48.225100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:15:48.225976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:48.227316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 527/1053] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:48 2021] GET /identity/v3/roles/019207b971e242a29fd501b9b5a887f8 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:48.233470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6627-d5ef-4dac-8340-c1faadf8ff7c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:48.242141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d6627-d5ef-4dac-8340-c1faadf8ff7c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:48.247088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:48.247919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:48.248197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:48.248469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] PATH_INFO: `/v3/users/18ecbc0934b1435f8754a11e8343ad85` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:48.262077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] RBAC: Authorizing `identity:get_user(user_id=18ecbc0934b1435f8754a11e8343ad85)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:48.264227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:48.265803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 527/1054] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:48 2021] GET /identity/v3/users/18ecbc0934b1435f8754a11e8343ad85 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:48.272059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:48.281404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47cb53-8416-4edc-ad48-67e670f2e438 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:48.285878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:48.286526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:48.286811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:48.287087 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:48.295626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:48.297338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:48.305891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 528/1055] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:15:48.312856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:48.321967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec57cf-4049-45b7-b48f-8f650369cfeb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:48.326657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f72a61-bf9c-4bb6-9f28-c9133a8b4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:48.327464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f72a61-bf9c-4bb6-9f28-c9133a8b4919 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:48.327742 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f72a61-bf9c-4bb6-9f28-c9133a8b4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:48.328011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f72a61-bf9c-4bb6-9f28-c9133a8b4919 admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:48.329159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f72a61-bf9c-4bb6-9f28-c9133a8b4919 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d87ad2ecf9a4de28370ec953d3fab63)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:48.331188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f72a61-bf9c-4bb6-9f28-c9133a8b4919 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:48.332772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 528/1056] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:15:48 2021] GET /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:15:48.339166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:48.347858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fbb95-90b8-4813-9b83-0d9d1759c8e0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:48.352349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdb7f5-cb21-49b6-9fb6-488685be1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:48.352965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb7f5-cb21-49b6-9fb6-488685be1d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:48.353245 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb7f5-cb21-49b6-9fb6-488685be1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:48.353521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb7f5-cb21-49b6-9fb6-488685be1d48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:48.354380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdb7f5-cb21-49b6-9fb6-488685be1d48 admin admin] RBAC: Adding query filter params (role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63, user.id=18ecbc0934b1435f8754a11e8343ad85) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:48.355511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdb7f5-cb21-49b6-9fb6-488685be1d48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:48.357241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdb7f5-cb21-49b6-9fb6-488685be1d48 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:48.362434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 529/1057] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:48 2021] GET /identity/v3/role_assignments?user.id=18ecbc0934b1435f8754a11e8343ad85&scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63&role.id=019207b971e242a29fd501b9b5a887f8 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:50.598730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5430-0db1-4561-896a-c1f6863c541e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:50.599224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5430-0db1-4561-896a-c1f6863c541e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:50.599314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5430-0db1-4561-896a-c1f6863c541e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:50.601057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 529/1058] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:50.606999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21ce9-1420-482f-9ed4-1c6137fcb5b9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:50.607419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21ce9-1420-482f-9ed4-1c6137fcb5b9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:50.607603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21ce9-1420-482f-9ed4-1c6137fcb5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:50.624716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c2f21ce9-1420-482f-9ed4-1c6137fcb5b9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:50.625882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c2f21ce9-1420-482f-9ed4-1c6137fcb5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:50.633650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 530/1059] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:50.658979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5430-0db1-4561-896a-c1f6863c541e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:50.671321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5430-0db1-4561-896a-c1f6863c541e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:50.675655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:50.676475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:50.676755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:50.677029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] PATH_INFO: `/v3/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:50.678545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] RBAC: Authorizing `identity:get_role(role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:50.679560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:15:50.679560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:15:50.679560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:15:50.680424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:50.681722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 530/1060] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:50 2021] GET /identity/v3/roles/019207b971e242a29fd501b9b5a887f8 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:50.687709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f21ce9-1420-482f-9ed4-1c6137fcb5b9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:50.696278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f21ce9-1420-482f-9ed4-1c6137fcb5b9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:50.701291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:50.702123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:50.702454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:50.702731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] PATH_INFO: `/v3/users/18ecbc0934b1435f8754a11e8343ad85` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:50.703932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] RBAC: Authorizing `identity:get_user(user_id=18ecbc0934b1435f8754a11e8343ad85)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:50.706016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:50.707689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 531/1061] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:50 2021] GET /identity/v3/users/18ecbc0934b1435f8754a11e8343ad85 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:50.713598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:50.723790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80466-3637-4967-9cb1-21a4784a665e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:50.728183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdbaec-fe44-4545-8666-0be0680c86d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:50.728969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdbaec-fe44-4545-8666-0be0680c86d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:50.729252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdbaec-fe44-4545-8666-0be0680c86d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:50.729954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdbaec-fe44-4545-8666-0be0680c86d9 admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:50.731164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdbaec-fe44-4545-8666-0be0680c86d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d87ad2ecf9a4de28370ec953d3fab63)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:50.733152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdbaec-fe44-4545-8666-0be0680c86d9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:50.734778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 531/1062] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:15:50 2021] GET /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:50.740709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:50.749851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d464e-3284-4792-aea2-6bd576f3c7dc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:50.754248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04947bf6-e062-43d5-af4b-295d3b31ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:50.755071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947bf6-e062-43d5-af4b-295d3b31ace1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:50.755350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947bf6-e062-43d5-af4b-295d3b31ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:50.755625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947bf6-e062-43d5-af4b-295d3b31ace1 admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63/users/18ecbc0934b1435f8754a11e8343ad85/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:50.758064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947bf6-e062-43d5-af4b-295d3b31ace1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d87ad2ecf9a4de28370ec953d3fab63, user_id=18ecbc0934b1435f8754a11e8343ad85, role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:50.761242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947bf6-e062-43d5-af4b-295d3b31ace1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:50.862625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 532/1063] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:15:50 2021] PUT /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63/users/18ecbc0934b1435f8754a11e8343ad85/roles/019207b971e242a29fd501b9b5a887f8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:15:53.096091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37b9f-183c-4183-8108-924f6950ac7f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:53.096643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37b9f-183c-4183-8108-924f6950ac7f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:53.096643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db37b9f-183c-4183-8108-924f6950ac7f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:53.098454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 532/1064] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:53.104865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5582845-4d85-422b-85e5-4bc222a29bf6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:53.105257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5582845-4d85-422b-85e5-4bc222a29bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:53.105424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5582845-4d85-422b-85e5-4bc222a29bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:53.123029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c5582845-4d85-422b-85e5-4bc222a29bf6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:53.124203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c5582845-4d85-422b-85e5-4bc222a29bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:53.178413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 533/1065] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:53.204793 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37b9f-183c-4183-8108-924f6950ac7f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:53.217459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db37b9f-183c-4183-8108-924f6950ac7f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:53.221819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:53.222687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:53.222971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:53.223248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] PATH_INFO: `/v3/roles/019207b971e242a29fd501b9b5a887f8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:53.224732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] RBAC: Authorizing `identity:get_role(role_id=019207b971e242a29fd501b9b5a887f8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:53.226367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:53.227683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 533/1066] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:53 2021] GET /identity/v3/roles/019207b971e242a29fd501b9b5a887f8 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:53.234538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5582845-4d85-422b-85e5-4bc222a29bf6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:53.243257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5582845-4d85-422b-85e5-4bc222a29bf6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:53.247840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:53.248689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:53.248971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:53.249246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] PATH_INFO: `/v3/users/18ecbc0934b1435f8754a11e8343ad85` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:53.250484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] RBAC: Authorizing `identity:get_user(user_id=18ecbc0934b1435f8754a11e8343ad85)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:53.252579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:53.254140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 534/1067] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:15:53 2021] GET /identity/v3/users/18ecbc0934b1435f8754a11e8343ad85 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:53.260392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:53.269643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e9b5-cf47-4a41-b96f-6ffd96395533 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:53.274064 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:53.274704 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:53.274991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:53.275267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:53.283499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:53.285193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:53.294540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 534/1068] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:15:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:15:53.300639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:53.310102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e839749-540d-46c9-bf35-17accc58674d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:53.314556 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f1a77-a25c-402c-9413-9e1571f6853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:53.315365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f1a77-a25c-402c-9413-9e1571f6853e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:53.315646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f1a77-a25c-402c-9413-9e1571f6853e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:53.315922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f1a77-a25c-402c-9413-9e1571f6853e admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:53.317092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f1a77-a25c-402c-9413-9e1571f6853e admin admin] RBAC: Authorizing `identity:get_project(project_id=4d87ad2ecf9a4de28370ec953d3fab63)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:53.319139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f1a77-a25c-402c-9413-9e1571f6853e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:53.320914 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 535/1069] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:15:53 2021] GET /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:53.327043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:53.335472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e9a2e-9bca-4f79-8d2c-e80afebbfa68 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:53.340517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc27abe-9f95-412e-a6aa-ca33905190af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:53.341180 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27abe-9f95-412e-a6aa-ca33905190af admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:53.341461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27abe-9f95-412e-a6aa-ca33905190af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:53.341736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc27abe-9f95-412e-a6aa-ca33905190af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:53.342612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc27abe-9f95-412e-a6aa-ca33905190af admin admin] RBAC: Adding query filter params (role.id=019207b971e242a29fd501b9b5a887f8, scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63, user.id=18ecbc0934b1435f8754a11e8343ad85) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:15:53.342923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc27abe-9f95-412e-a6aa-ca33905190af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:53.344706 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc27abe-9f95-412e-a6aa-ca33905190af admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:53.350409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 535/1070] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:15:53 2021] GET /identity/v3/role_assignments?user.id=18ecbc0934b1435f8754a11e8343ad85&scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63&role.id=019207b971e242a29fd501b9b5a887f8 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:55.613274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6cd98-c9e6-4713-8152-90ed7c1d7835 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:55.613807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6cd98-c9e6-4713-8152-90ed7c1d7835 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:55.613807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6cd98-c9e6-4713-8152-90ed7c1d7835 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:55.615635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 536/1071] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:55.622152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e409cfb-4033-462f-a9ca-2929196d5c5a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:55.622586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e409cfb-4033-462f-a9ca-2929196d5c5a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:55.622729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e409cfb-4033-462f-a9ca-2929196d5c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:55.640560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7e409cfb-4033-462f-a9ca-2929196d5c5a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:55.641977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7e409cfb-4033-462f-a9ca-2929196d5c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:55.649848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 536/1072] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:55.675683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6cd98-c9e6-4713-8152-90ed7c1d7835 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:55.688148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6cd98-c9e6-4713-8152-90ed7c1d7835 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:55.692442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063f103-4f4f-45a4-9c38-ef3303b93df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:55.693205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f103-4f4f-45a4-9c38-ef3303b93df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:55.693487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f103-4f4f-45a4-9c38-ef3303b93df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:55.693762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063f103-4f4f-45a4-9c38-ef3303b93df8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:55.694962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063f103-4f4f-45a4-9c38-ef3303b93df8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:55.696755 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063f103-4f4f-45a4-9c38-ef3303b93df8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:55.699127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 537/1073] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:55.705260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e409cfb-4033-462f-a9ca-2929196d5c5a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:55.714042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e409cfb-4033-462f-a9ca-2929196d5c5a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:55.718429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132b504-6936-4432-a9bc-4df413fe6be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:55.719062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b504-6936-4432-a9bc-4df413fe6be9 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:55.719343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b504-6936-4432-a9bc-4df413fe6be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:55.719617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b504-6936-4432-a9bc-4df413fe6be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:55.720338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132b504-6936-4432-a9bc-4df413fe6be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:55.722226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132b504-6936-4432-a9bc-4df413fe6be9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:55.854973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 537/1074] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:15:55 2021] POST /identity/v3/projects => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:15:58.148859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb920-3bec-4d2a-a1d7-3284b3656caf None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:58.149417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb920-3bec-4d2a-a1d7-3284b3656caf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:58.149417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb920-3bec-4d2a-a1d7-3284b3656caf None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:58.151452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 538/1075] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:15:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:15:58.157317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c011-8663-45d2-830b-5ec0717e138b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:58.157718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c011-8663-45d2-830b-5ec0717e138b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:58.157879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c011-8663-45d2-830b-5ec0717e138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:58.175597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5648c011-8663-45d2-830b-5ec0717e138b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:15:58.176784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5648c011-8663-45d2-830b-5ec0717e138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:15:58.232314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 538/1076] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:15:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:15:58.260142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeb920-3bec-4d2a-a1d7-3284b3656caf None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:58.271956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeb920-3bec-4d2a-a1d7-3284b3656caf None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:58.276223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81b3a2-4fb6-4c92-a9be-39975327fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:58.276979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81b3a2-4fb6-4c92-a9be-39975327fe7e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:58.277259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81b3a2-4fb6-4c92-a9be-39975327fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:58.277534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81b3a2-4fb6-4c92-a9be-39975327fe7e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:58.278721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81b3a2-4fb6-4c92-a9be-39975327fe7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:58.280373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81b3a2-4fb6-4c92-a9be-39975327fe7e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:58.281902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 539/1077] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:15:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:15:58.288038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c011-8663-45d2-830b-5ec0717e138b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:15:58.297650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c011-8663-45d2-830b-5ec0717e138b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:15:58.302038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5f792-c831-4a03-8556-024b53076c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:15:58.302723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f792-c831-4a03-8556-024b53076c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:15:58.303012 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f792-c831-4a03-8556-024b53076c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:15:58.303286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f792-c831-4a03-8556-024b53076c50 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:15:58.304001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5f792-c831-4a03-8556-024b53076c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:15:58.305924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5f792-c831-4a03-8556-024b53076c50 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:15:58.406770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 539/1078] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:15:58 2021] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:16:00.744827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d998-fee8-4b41-a452-3b960361d131 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:00.745461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d998-fee8-4b41-a452-3b960361d131 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:00.745461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d998-fee8-4b41-a452-3b960361d131 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:00.747277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 540/1079] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:00.753344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572508f-6b38-4cc3-859c-ae2ff0774495 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:00.753764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572508f-6b38-4cc3-859c-ae2ff0774495 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:00.753900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572508f-6b38-4cc3-859c-ae2ff0774495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:00.772146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4572508f-6b38-4cc3-859c-ae2ff0774495 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:00.773342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4572508f-6b38-4cc3-859c-ae2ff0774495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:00.781449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 540/1080] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:00.808613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131d998-fee8-4b41-a452-3b960361d131 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:00.820468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131d998-fee8-4b41-a452-3b960361d131 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:00.825617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:00.826401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:00.826690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:00.826971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:00.836837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:16:00.843720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:16:00.844862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 541/1081] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:16:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:16:00.851338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572508f-6b38-4cc3-859c-ae2ff0774495 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:00.860283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572508f-6b38-4cc3-859c-ae2ff0774495 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:00.864830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:00.865474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:00.865760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:00.866037 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:00.866839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:00.867149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:00.868738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:00.877327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 541/1082] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:16:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:00.883710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:00.894595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb38a3-26a1-44c0-9c06-68d40f79415c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:00.899042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:00.899858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:00.900139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:00.900410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] PATH_INFO: `/v3/users/400a0a3eb518433b95031e9677a1d159` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:00.913356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] RBAC: Authorizing `identity:get_user(user_id=400a0a3eb518433b95031e9677a1d159)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:00.915589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:00.917629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 542/1083] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:16:00 2021] GET /identity/v3/users/400a0a3eb518433b95031e9677a1d159 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:00.923841 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:00.933805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d43db-5813-4a26-af97-9026c09d73a3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:00.938350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:00.938966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:00.939250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:00.939526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:00.947105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:00.949705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:00.958269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 542/1084] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:16:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:16:00.964881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:00.973955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c733b-3b5e-427b-a066-84d936e38839 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:00.978384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1777093-9d5b-4d2a-885b-f19885010df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:00.979741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1777093-9d5b-4d2a-885b-f19885010df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:00.980023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1777093-9d5b-4d2a-885b-f19885010df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:00.980303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1777093-9d5b-4d2a-885b-f19885010df4 admin admin] PATH_INFO: `/v3/projects/aca1441d94094af2944b11f01b77b6a4` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:00.981466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1777093-9d5b-4d2a-885b-f19885010df4 admin admin] RBAC: Authorizing `identity:get_project(project_id=aca1441d94094af2944b11f01b77b6a4)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:00.983489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1777093-9d5b-4d2a-885b-f19885010df4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:00.985230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 543/1085] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:16:00 2021] GET /identity/v3/projects/aca1441d94094af2944b11f01b77b6a4 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:00.991210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:01.000177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e40301-2247-40bf-a7f7-69f5d7e64ee0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:01.004711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f3839-1f0a-4100-88b1-c94aa13afa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:01.005326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f3839-1f0a-4100-88b1-c94aa13afa47 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:01.005867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f3839-1f0a-4100-88b1-c94aa13afa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:01.006144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f3839-1f0a-4100-88b1-c94aa13afa47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:01.007010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f3839-1f0a-4100-88b1-c94aa13afa47 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=aca1441d94094af2944b11f01b77b6a4, user.id=400a0a3eb518433b95031e9677a1d159) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:01.007321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f3839-1f0a-4100-88b1-c94aa13afa47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:01.009104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f3839-1f0a-4100-88b1-c94aa13afa47 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:01.014911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 543/1086] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:16:00 2021] GET /identity/v3/role_assignments?user.id=400a0a3eb518433b95031e9677a1d159&scope.project.id=aca1441d94094af2944b11f01b77b6a4&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:03.277944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45161656-688b-4096-99ae-53955e6d44db None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:03.278511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45161656-688b-4096-99ae-53955e6d44db None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:03.278511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45161656-688b-4096-99ae-53955e6d44db None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:03.280305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 544/1087] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:03.286197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e003d-d153-4fd7-9ace-23dfbb84cfab None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:03.286589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e003d-d153-4fd7-9ace-23dfbb84cfab None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:03.286781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e003d-d153-4fd7-9ace-23dfbb84cfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:03.304988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-273e003d-d153-4fd7-9ace-23dfbb84cfab None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:03.306158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-273e003d-d153-4fd7-9ace-23dfbb84cfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:03.314390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 544/1088] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:03.339345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45161656-688b-4096-99ae-53955e6d44db None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:03.351250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45161656-688b-4096-99ae-53955e6d44db None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:03.355649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:03.356412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:03.356698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:03.356976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:03.366852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:16:03.373708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:16:03.374914 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 545/1089] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:16:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:16:03.382812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e003d-d153-4fd7-9ace-23dfbb84cfab None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:03.392428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e003d-d153-4fd7-9ace-23dfbb84cfab None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:03.396955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:03.397604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:03.397888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:03.398164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:03.398953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:03.399269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:03.401672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:03.409727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 545/1090] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:16:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:03.415788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:03.425933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baacfd3-260c-4ae7-90f8-d84b9cfd0ec7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:03.430373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:03.431190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:03.431466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:03.431737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] PATH_INFO: `/v3/users/400a0a3eb518433b95031e9677a1d159` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:03.432918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] RBAC: Authorizing `identity:get_user(user_id=400a0a3eb518433b95031e9677a1d159)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:03.435050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:03.436582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 546/1091] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:16:03 2021] GET /identity/v3/users/400a0a3eb518433b95031e9677a1d159 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:03.442407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:03.452573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fd313-9188-47b3-829d-5b65225bca0c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:03.456983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d8755-db0f-4329-ab68-736c374d3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:03.457796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8755-db0f-4329-ab68-736c374d3bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:03.458079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8755-db0f-4329-ab68-736c374d3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:03.458395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d8755-db0f-4329-ab68-736c374d3bf6 admin admin] PATH_INFO: `/v3/projects/aca1441d94094af2944b11f01b77b6a4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:03.459570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d8755-db0f-4329-ab68-736c374d3bf6 admin admin] RBAC: Authorizing `identity:get_project(project_id=aca1441d94094af2944b11f01b77b6a4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:03.461584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d8755-db0f-4329-ab68-736c374d3bf6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:03.464358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 546/1092] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:16:03 2021] GET /identity/v3/projects/aca1441d94094af2944b11f01b77b6a4 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:03.470270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:03.480099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5564ab-41f5-43c2-91c2-f016c3f39102 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:03.484465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd52a6b-d414-483e-a008-f9d276df6425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:03.485293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52a6b-d414-483e-a008-f9d276df6425 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:03.485576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52a6b-d414-483e-a008-f9d276df6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:03.485850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52a6b-d414-483e-a008-f9d276df6425 admin admin] PATH_INFO: `/v3/projects/aca1441d94094af2944b11f01b77b6a4/users/400a0a3eb518433b95031e9677a1d159/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:03.487830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd52a6b-d414-483e-a008-f9d276df6425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca1441d94094af2944b11f01b77b6a4, user_id=400a0a3eb518433b95031e9677a1d159, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:03.490405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd52a6b-d414-483e-a008-f9d276df6425 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:03.561525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 547/1093] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:16:03 2021] PUT /identity/v3/projects/aca1441d94094af2944b11f01b77b6a4/users/400a0a3eb518433b95031e9677a1d159/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:16:05.804529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69152f-0329-475f-a48d-ffc499a3f75f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:05.805077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69152f-0329-475f-a48d-ffc499a3f75f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:05.805077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69152f-0329-475f-a48d-ffc499a3f75f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:05.807400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 547/1094] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:05.813298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1331a0f-c021-496c-b05a-b4d3cc5e2890 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:05.813697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1331a0f-c021-496c-b05a-b4d3cc5e2890 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:05.813847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1331a0f-c021-496c-b05a-b4d3cc5e2890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:05.832102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a1331a0f-c021-496c-b05a-b4d3cc5e2890 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:05.833272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a1331a0f-c021-496c-b05a-b4d3cc5e2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:05.891067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 548/1095] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:05.916858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69152f-0329-475f-a48d-ffc499a3f75f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:05.928767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69152f-0329-475f-a48d-ffc499a3f75f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:05.933749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:05.934542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:05.934827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:05.935101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:05.945003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:16:05.951712 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:16:05.952845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 548/1096] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:16:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:16:05.959237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1331a0f-c021-496c-b05a-b4d3cc5e2890 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:05.968314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1331a0f-c021-496c-b05a-b4d3cc5e2890 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:05.972851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:05.973493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:05.973774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:05.974053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:05.974859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:05.975165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:05.976727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:05.985260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 549/1097] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:16:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:16:05.991205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:06.001220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455714-df0c-48e3-ba0b-892a995ffc39 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:06.006212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:06.007044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:06.007330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:06.007612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] PATH_INFO: `/v3/users/400a0a3eb518433b95031e9677a1d159` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:06.008817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] RBAC: Authorizing `identity:get_user(user_id=400a0a3eb518433b95031e9677a1d159)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:06.011084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:06.012652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 549/1098] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:16:05 2021] GET /identity/v3/users/400a0a3eb518433b95031e9677a1d159 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:06.018518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:06.028262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c02e66-0419-4de0-999a-ec62fe7e72c7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:06.032758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:06.033377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:06.033663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:06.033943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:06.042068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:06.043813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:06.052319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 550/1099] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:16:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:16:06.058435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:06.067575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e1eb-9110-4ceb-999f-b69d43f0792b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:06.072012 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a161a-2583-4c40-833d-2f17d2ffb76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:06.072883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a161a-2583-4c40-833d-2f17d2ffb76f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:06.073158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a161a-2583-4c40-833d-2f17d2ffb76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:06.073427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a161a-2583-4c40-833d-2f17d2ffb76f admin admin] PATH_INFO: `/v3/projects/aca1441d94094af2944b11f01b77b6a4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:06.074617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a161a-2583-4c40-833d-2f17d2ffb76f admin admin] RBAC: Authorizing `identity:get_project(project_id=aca1441d94094af2944b11f01b77b6a4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:06.076608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a161a-2583-4c40-833d-2f17d2ffb76f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:06.078371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 550/1100] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:16:06 2021] GET /identity/v3/projects/aca1441d94094af2944b11f01b77b6a4 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:16:06.084218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:06.093051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778b863-848c-4c8c-8e91-0ceed6b33496 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:06.097480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60085c-81d8-47ea-be97-266ea1351daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:06.098088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60085c-81d8-47ea-be97-266ea1351daa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:06.098399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60085c-81d8-47ea-be97-266ea1351daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:06.098677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60085c-81d8-47ea-be97-266ea1351daa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:06.099495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60085c-81d8-47ea-be97-266ea1351daa admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=aca1441d94094af2944b11f01b77b6a4, user.id=400a0a3eb518433b95031e9677a1d159) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:06.099802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60085c-81d8-47ea-be97-266ea1351daa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:06.101568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60085c-81d8-47ea-be97-266ea1351daa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:06.107920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 551/1101] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:16:06 2021] GET /identity/v3/role_assignments?user.id=400a0a3eb518433b95031e9677a1d159&scope.project.id=aca1441d94094af2944b11f01b77b6a4&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:08.365066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b37f4-d60d-4d6e-9b75-9c6218212fd8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:08.365601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b37f4-d60d-4d6e-9b75-9c6218212fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:08.365601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b37f4-d60d-4d6e-9b75-9c6218212fd8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:08.367427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 551/1102] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:08.373931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbaaae-8c82-4f16-804e-d9e98ae8d565 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:08.374395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbaaae-8c82-4f16-804e-d9e98ae8d565 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:08.374513 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbaaae-8c82-4f16-804e-d9e98ae8d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:08.392562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b0fbaaae-8c82-4f16-804e-d9e98ae8d565 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:08.393752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b0fbaaae-8c82-4f16-804e-d9e98ae8d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:08.401332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 552/1103] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:08.423998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b37f4-d60d-4d6e-9b75-9c6218212fd8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:08.436796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b37f4-d60d-4d6e-9b75-9c6218212fd8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:08.441193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:08.441820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:08.442107 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:08.442417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:08.450819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:08.452617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:08.461359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 552/1104] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:16:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:16:08.469382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbaaae-8c82-4f16-804e-d9e98ae8d565 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:08.478040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbaaae-8c82-4f16-804e-d9e98ae8d565 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:08.482742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95953c6-2363-4b07-8f67-be6ae4a1dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:08.483547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95953c6-2363-4b07-8f67-be6ae4a1dcad admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:08.483820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95953c6-2363-4b07-8f67-be6ae4a1dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:08.484096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95953c6-2363-4b07-8f67-be6ae4a1dcad admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:08.490737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95953c6-2363-4b07-8f67-be6ae4a1dcad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:08.492532 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95953c6-2363-4b07-8f67-be6ae4a1dcad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:08.506607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d95953c6-2363-4b07-8f67-be6ae4a1dcad admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 11 16:16:08.507754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 553/1105] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:16:08 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:16:08.515238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:08.524086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c94be-ae90-4de7-b690-0efdbc291246 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:08.529516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bfd6c-3650-4cc9-8aea-beb3ee840576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:08.530161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bfd6c-3650-4cc9-8aea-beb3ee840576 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:08.530485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bfd6c-3650-4cc9-8aea-beb3ee840576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:08.530765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bfd6c-3650-4cc9-8aea-beb3ee840576 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:08.531510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bfd6c-3650-4cc9-8aea-beb3ee840576 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:08.531821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bfd6c-3650-4cc9-8aea-beb3ee840576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:08.533419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bfd6c-3650-4cc9-8aea-beb3ee840576 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:08.541570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 553/1106] 10.222.0.11 () {56 vars in 1136 bytes} [Thu Nov 11 16:16:08 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:10.765535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314050b-9371-4b2e-b6b7-d213dd848600 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:10.766054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314050b-9371-4b2e-b6b7-d213dd848600 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:10.766144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314050b-9371-4b2e-b6b7-d213dd848600 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:10.767893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 554/1107] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:10.773679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19679e2-ff6c-4b2f-b58c-174116a7b7d4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:10.774112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19679e2-ff6c-4b2f-b58c-174116a7b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:10.774262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19679e2-ff6c-4b2f-b58c-174116a7b7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:10.793066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d19679e2-ff6c-4b2f-b58c-174116a7b7d4 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:10.794559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d19679e2-ff6c-4b2f-b58c-174116a7b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:10.803200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 554/1108] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:10.828706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314050b-9371-4b2e-b6b7-d213dd848600 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:10.841372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314050b-9371-4b2e-b6b7-d213dd848600 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:10.845695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1a771-9fba-441b-a418-9855359f02cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:10.846363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1a771-9fba-441b-a418-9855359f02cb admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:10.846651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1a771-9fba-441b-a418-9855359f02cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:10.846930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1a771-9fba-441b-a418-9855359f02cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:10.847696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1a771-9fba-441b-a418-9855359f02cb admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:10.848692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-23d1a771-9fba-441b-a418-9855359f02cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:16:10.848692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:16:10.848692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:16:10.849581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1a771-9fba-441b-a418-9855359f02cb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:10.931238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 555/1109] 10.222.0.11 () {60 vars in 1159 bytes} [Thu Nov 11 16:16:10 2021] POST /identity/v3/domains => generated 267 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:16:13.209903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6bc79-f7ae-4b27-b93f-e7fbbf955ff1 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:13.210497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6bc79-f7ae-4b27-b93f-e7fbbf955ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:13.210497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6bc79-f7ae-4b27-b93f-e7fbbf955ff1 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:13.212259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 555/1110] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:13.218931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14defef-7979-4704-b31a-eb52ee6f4798 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:13.219348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14defef-7979-4704-b31a-eb52ee6f4798 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:13.219502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14defef-7979-4704-b31a-eb52ee6f4798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:13.237421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a14defef-7979-4704-b31a-eb52ee6f4798 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:13.238635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a14defef-7979-4704-b31a-eb52ee6f4798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:13.293665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 556/1111] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:13.319569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6bc79-f7ae-4b27-b93f-e7fbbf955ff1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:13.332473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6bc79-f7ae-4b27-b93f-e7fbbf955ff1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:13.336805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6897b82-f0f9-4a70-b4b9-9c062f6a17aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:13.338383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897b82-f0f9-4a70-b4b9-9c062f6a17aa admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:13.338667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897b82-f0f9-4a70-b4b9-9c062f6a17aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:13.338943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6897b82-f0f9-4a70-b4b9-9c062f6a17aa admin admin] PATH_INFO: `/v3/domains/9d1a50101cd040e39286c17a6c45b1cc` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:13.349145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6897b82-f0f9-4a70-b4b9-9c062f6a17aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=9d1a50101cd040e39286c17a6c45b1cc)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:13.351137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6897b82-f0f9-4a70-b4b9-9c062f6a17aa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:13.352703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 556/1112] 10.222.0.11 () {56 vars in 1204 bytes} [Thu Nov 11 16:16:13 2021] GET /identity/v3/domains/9d1a50101cd040e39286c17a6c45b1cc => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:13.359024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14defef-7979-4704-b31a-eb52ee6f4798 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:13.367746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14defef-7979-4704-b31a-eb52ee6f4798 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:13.372542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef422cd-2d20-4040-a0bc-04bb69edfcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:13.373187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef422cd-2d20-4040-a0bc-04bb69edfcad admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:13.373473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef422cd-2d20-4040-a0bc-04bb69edfcad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:13.373752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef422cd-2d20-4040-a0bc-04bb69edfcad admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:13.374523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef422cd-2d20-4040-a0bc-04bb69edfcad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:13.376403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef422cd-2d20-4040-a0bc-04bb69edfcad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:13.481690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 557/1113] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:16:13 2021] POST /identity/v3/projects => generated 361 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:16:15.795288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a7cd1-aadd-4b2a-8f63-61b57a89d198 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:15.795808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a7cd1-aadd-4b2a-8f63-61b57a89d198 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:15.795808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a7cd1-aadd-4b2a-8f63-61b57a89d198 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:15.797528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 557/1114] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:15.803589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cae2-7feb-4388-baa8-ad86597ee67f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:15.803975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cae2-7feb-4388-baa8-ad86597ee67f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:15.804152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cae2-7feb-4388-baa8-ad86597ee67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:15.822626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b394cae2-7feb-4388-baa8-ad86597ee67f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:15.823809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b394cae2-7feb-4388-baa8-ad86597ee67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:15.877741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 558/1115] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:15.906268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a7cd1-aadd-4b2a-8f63-61b57a89d198 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:15.918239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a7cd1-aadd-4b2a-8f63-61b57a89d198 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:15.922534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be363582-ce0e-45f2-a9ec-4f96477373c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:15.923363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363582-ce0e-45f2-a9ec-4f96477373c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:15.923642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363582-ce0e-45f2-a9ec-4f96477373c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:15.923914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be363582-ce0e-45f2-a9ec-4f96477373c3 admin admin] PATH_INFO: `/v3/domains/9d1a50101cd040e39286c17a6c45b1cc` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:15.925091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be363582-ce0e-45f2-a9ec-4f96477373c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=9d1a50101cd040e39286c17a6c45b1cc)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:15.927065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be363582-ce0e-45f2-a9ec-4f96477373c3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:15.928605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 558/1116] 10.222.0.11 () {56 vars in 1204 bytes} [Thu Nov 11 16:16:15 2021] GET /identity/v3/domains/9d1a50101cd040e39286c17a6c45b1cc => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:15.935084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394cae2-7feb-4388-baa8-ad86597ee67f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:15.943728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394cae2-7feb-4388-baa8-ad86597ee67f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:15.948720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d015c-fcf2-435b-b122-fae558101280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:15.949361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d015c-fcf2-435b-b122-fae558101280 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:15.949639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d015c-fcf2-435b-b122-fae558101280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:15.949911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d015c-fcf2-435b-b122-fae558101280 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:15.950681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d015c-fcf2-435b-b122-fae558101280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:15.952558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d015c-fcf2-435b-b122-fae558101280 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:16.063452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 559/1117] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:16:15 2021] POST /identity/v3/users => generated 311 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:16:18.412352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bcc0-e5bb-4e87-b69e-a12a65bd6a60 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.412910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bcc0-e5bb-4e87-b69e-a12a65bd6a60 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.412910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bcc0-e5bb-4e87-b69e-a12a65bd6a60 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.414706 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 559/1118] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:18.421495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42259-735f-4381-98a9-bc1b1ee85cee None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.421869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42259-735f-4381-98a9-bc1b1ee85cee None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.422057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a42259-735f-4381-98a9-bc1b1ee85cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.440298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a8a42259-735f-4381-98a9-bc1b1ee85cee None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:18.441478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a8a42259-735f-4381-98a9-bc1b1ee85cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:18.449503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 560/1119] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:18.475901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bcc0-e5bb-4e87-b69e-a12a65bd6a60 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:18.488534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bcc0-e5bb-4e87-b69e-a12a65bd6a60 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:18.492819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:18.494349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.494635 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.494907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.505321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:16:18.512214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:16:18.513333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 560/1120] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:16:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:16:18.519867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42259-735f-4381-98a9-bc1b1ee85cee None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:18.528648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a42259-735f-4381-98a9-bc1b1ee85cee None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:18.533197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:18.533854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.534138 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.534445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.535223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:18.535534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:18.537137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:18.546293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 561/1121] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:16:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:18.552590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:18.562745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2587-52ce-415e-beda-32bea1c26afd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:18.567197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:18.568027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.568303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.568572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] PATH_INFO: `/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.582112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] RBAC: Authorizing `identity:get_user(user_id=fc7996bea5e8465d8cdc4af214e4c6b1)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:18.584301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:18.585862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 561/1122] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:16:18 2021] GET /identity/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:18.592906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:18.602307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e93e0-4db8-4abb-ae8b-f3342ea289aa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:18.606918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:18.607548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.607834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.608112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.615731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:18.617462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:18.626084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 562/1123] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:16:18 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:16:18.632705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:18.642794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f71f38-4ccd-4c26-a0a5-711050adb1ff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:18.647250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453a287-d903-4487-b06d-27c060a71eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:18.648071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453a287-d903-4487-b06d-27c060a71eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.648351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453a287-d903-4487-b06d-27c060a71eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.648624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453a287-d903-4487-b06d-27c060a71eb1 admin admin] PATH_INFO: `/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.650472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453a287-d903-4487-b06d-27c060a71eb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=8512c2c73155450bb57c7b9b5fe2b6c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:18.652516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453a287-d903-4487-b06d-27c060a71eb1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:18.654129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 562/1124] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:16:18 2021] GET /identity/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:18.660354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:18.669033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8bdb9-3545-4e3c-b24d-1608ca56a6ac admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:18.673458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4c6e8-3eb0-4c65-999c-fca1dc02c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:18.674073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c6e8-3eb0-4c65-999c-fca1dc02c312 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:18.674393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c6e8-3eb0-4c65-999c-fca1dc02c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:18.674674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c6e8-3eb0-4c65-999c-fca1dc02c312 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:18.675503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4c6e8-3eb0-4c65-999c-fca1dc02c312 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=8512c2c73155450bb57c7b9b5fe2b6c8, user.id=fc7996bea5e8465d8cdc4af214e4c6b1) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:18.675814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4c6e8-3eb0-4c65-999c-fca1dc02c312 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:18.677602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4c6e8-3eb0-4c65-999c-fca1dc02c312 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:18.683686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 563/1125] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:16:18 2021] GET /identity/v3/role_assignments?user.id=fc7996bea5e8465d8cdc4af214e4c6b1&scope.project.id=8512c2c73155450bb57c7b9b5fe2b6c8&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:20.964922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0a01-0929-4c85-b123-43939bfb6146 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:20.965439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0a01-0929-4c85-b123-43939bfb6146 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:20.965551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0a01-0929-4c85-b123-43939bfb6146 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:20.967295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 563/1126] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:20.973105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62e01c-5cb2-4c75-b9eb-71dd3090133e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:20.973513 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62e01c-5cb2-4c75-b9eb-71dd3090133e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:20.973663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62e01c-5cb2-4c75-b9eb-71dd3090133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:20.991539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ff62e01c-5cb2-4c75-b9eb-71dd3090133e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:20.992732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ff62e01c-5cb2-4c75-b9eb-71dd3090133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:21.000341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 564/1127] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:16:21.023450 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d0a01-0929-4c85-b123-43939bfb6146 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:21.035855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d0a01-0929-4c85-b123-43939bfb6146 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:21.040775 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:21.041610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:21.041893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:21.042172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:21.052104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:16:21.058861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:16:21.059984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 564/1128] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:16:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:16:21.067710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62e01c-5cb2-4c75-b9eb-71dd3090133e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:21.076737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62e01c-5cb2-4c75-b9eb-71dd3090133e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:21.081193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:21.081867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:21.082152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:21.082462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:21.083263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:21.083575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:21.085152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:21.093697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 565/1129] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:16:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:21.099801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:21.111276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6088c2f-5fb2-4e83-8414-084050c205b7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:21.115718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:21.116539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:21.116821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:21.117099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] PATH_INFO: `/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:21.118324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=fc7996bea5e8465d8cdc4af214e4c6b1)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:21.120419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:21.121961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 565/1130] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:16:21 2021] GET /identity/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:21.127871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:21.137703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8e18e-2fec-478a-9607-97d6084f6498 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:21.142101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4561f-d45a-4d59-9269-8aae76a36898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:21.142955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4561f-d45a-4d59-9269-8aae76a36898 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:21.143236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4561f-d45a-4d59-9269-8aae76a36898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:21.143510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4561f-d45a-4d59-9269-8aae76a36898 admin admin] PATH_INFO: `/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:21.144700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4561f-d45a-4d59-9269-8aae76a36898 admin admin] RBAC: Authorizing `identity:get_project(project_id=8512c2c73155450bb57c7b9b5fe2b6c8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:21.146747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4561f-d45a-4d59-9269-8aae76a36898 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:21.148378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 566/1131] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:16:21 2021] GET /identity/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:21.154934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:21.164102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac06660-e42e-48c2-8e09-7891cf1168f0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:21.169194 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd09ab-b053-45d1-81df-986e51739cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:21.170052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd09ab-b053-45d1-81df-986e51739cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:21.170384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd09ab-b053-45d1-81df-986e51739cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:21.170659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd09ab-b053-45d1-81df-986e51739cb7 admin admin] PATH_INFO: `/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8/users/fc7996bea5e8465d8cdc4af214e4c6b1/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:21.172594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd09ab-b053-45d1-81df-986e51739cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8512c2c73155450bb57c7b9b5fe2b6c8, user_id=fc7996bea5e8465d8cdc4af214e4c6b1, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:21.175200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd09ab-b053-45d1-81df-986e51739cb7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:21.300902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 566/1132] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:16:21 2021] PUT /identity/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8/users/fc7996bea5e8465d8cdc4af214e4c6b1/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:16:23.509108 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382671bd-2b5a-43da-942d-17423e27d7d8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.509671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382671bd-2b5a-43da-942d-17423e27d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.509671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382671bd-2b5a-43da-942d-17423e27d7d8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.511517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 567/1133] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:16:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:16:23.517989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c465-a3db-49fe-95bc-36a42f8149f7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.518438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c465-a3db-49fe-95bc-36a42f8149f7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.518592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34c465-a3db-49fe-95bc-36a42f8149f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.535942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1b34c465-a3db-49fe-95bc-36a42f8149f7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:16:23.537117 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1b34c465-a3db-49fe-95bc-36a42f8149f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:16:23.593385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 567/1134] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:16:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:16:23.619360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382671bd-2b5a-43da-942d-17423e27d7d8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:23.631650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382671bd-2b5a-43da-942d-17423e27d7d8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:23.636765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:23.637539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.637823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.638097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.648268 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:16:23.656063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:16:23.657221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 568/1135] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:16:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:16:23.663647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c465-a3db-49fe-95bc-36a42f8149f7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:23.672846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34c465-a3db-49fe-95bc-36a42f8149f7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:23.677288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:23.677933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.678239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.678515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.679274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:23.679578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:23.681444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:23.689338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 568/1136] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:16:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:23.695310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:23.706945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b0732-6471-43d1-94d1-4098ad5bc397 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:23.711318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:23.712883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.713236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.713510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] PATH_INFO: `/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.714719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] RBAC: Authorizing `identity:get_user(user_id=fc7996bea5e8465d8cdc4af214e4c6b1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:23.716803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:23.718378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 569/1137] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:16:23 2021] GET /identity/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:23.724583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:23.734014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35dbf-1eb5-40bc-b367-ab84f03e88c4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:23.738456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:23.739070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.739354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.739627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.747455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:23.749162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:23.758082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 569/1138] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:16:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:16:23.764653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:23.773594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1fec7-8614-464f-bd2a-bfca3056cb22 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:23.778847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5017c3-dd5e-4387-a3e7-157b98ba5fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:23.779644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5017c3-dd5e-4387-a3e7-157b98ba5fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.779926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5017c3-dd5e-4387-a3e7-157b98ba5fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.780200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5017c3-dd5e-4387-a3e7-157b98ba5fb0 admin admin] PATH_INFO: `/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.781342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5017c3-dd5e-4387-a3e7-157b98ba5fb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=8512c2c73155450bb57c7b9b5fe2b6c8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:23.783362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5017c3-dd5e-4387-a3e7-157b98ba5fb0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:23.784955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 570/1139] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:16:23 2021] GET /identity/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:16:23.791536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:16:23.800070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00f286-c528-494e-9dc6-35f28c572d09 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:16:23.804573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032243f-c309-4a2e-9674-58c23ea89d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:16:23.805189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032243f-c309-4a2e-9674-58c23ea89d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:16:23.805471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032243f-c309-4a2e-9674-58c23ea89d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:16:23.805779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032243f-c309-4a2e-9674-58c23ea89d94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:16:23.806647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032243f-c309-4a2e-9674-58c23ea89d94 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=8512c2c73155450bb57c7b9b5fe2b6c8, user.id=fc7996bea5e8465d8cdc4af214e4c6b1) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:16:23.806953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032243f-c309-4a2e-9674-58c23ea89d94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:16:23.808752 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032243f-c309-4a2e-9674-58c23ea89d94 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:16:23.814353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 570/1140] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:16:23 2021] GET /identity/v3/role_assignments?user.id=fc7996bea5e8465d8cdc4af214e4c6b1&scope.project.id=8512c2c73155450bb57c7b9b5fe2b6c8&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:42.110954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce52d-5e9d-4fbe-b4ea-704daa521ab9 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:42.111546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce52d-5e9d-4fbe-b4ea-704daa521ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:42.111546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fce52d-5e9d-4fbe-b4ea-704daa521ab9 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:42.113269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 571/1141] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:17:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:17:42.119159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1378578-50f7-428e-9837-df21af10e090 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:42.128396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1378578-50f7-428e-9837-df21af10e090 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:42.128396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1378578-50f7-428e-9837-df21af10e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:42.137703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d1378578-50f7-428e-9837-df21af10e090 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:17:42.138934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d1378578-50f7-428e-9837-df21af10e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:17:42.147476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 571/1142] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:17:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:17:42.174941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fce52d-5e9d-4fbe-b4ea-704daa521ab9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:42.186672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fce52d-5e9d-4fbe-b4ea-704daa521ab9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:42.191846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:42.192619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:42.192900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:42.193174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:42.203205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:42.205557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:42.222409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:42.223647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 572/1143] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:42.230346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1378578-50f7-428e-9837-df21af10e090 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:42.240384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1378578-50f7-428e-9837-df21af10e090 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:42.245057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e25214-77d2-40e1-942c-80e84c833a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:42.245693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e25214-77d2-40e1-942c-80e84c833a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:42.248840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e25214-77d2-40e1-942c-80e84c833a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:42.248840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e25214-77d2-40e1-942c-80e84c833a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:42.248840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e25214-77d2-40e1-942c-80e84c833a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:42.248840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e25214-77d2-40e1-942c-80e84c833a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:42.249164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e25214-77d2-40e1-942c-80e84c833a93 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:42.261302 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 572/1144] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:42.268339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:42.277999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14019-14c4-4450-a75d-68d7083d9cf3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:42.283045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0226a-4800-411f-8295-13db19b2ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:42.283690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0226a-4800-411f-8295-13db19b2ecd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:42.283974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0226a-4800-411f-8295-13db19b2ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:42.284250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0226a-4800-411f-8295-13db19b2ecd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:42.285057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0226a-4800-411f-8295-13db19b2ecd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:42.286997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0226a-4800-411f-8295-13db19b2ecd0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:42.374277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 573/1145] 10.222.0.11 () {60 vars in 1153 bytes} [Thu Nov 11 16:17:42 2021] POST /identity/v3/users => generated 251 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:17:44.686822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e349275-b6fd-4cbb-b301-f0af046d3185 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.687386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e349275-b6fd-4cbb-b301-f0af046d3185 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.687386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e349275-b6fd-4cbb-b301-f0af046d3185 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.689172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 573/1146] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:17:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:17:44.695056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40fa4-b6a4-4ad9-a144-925cb091ee83 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.695537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40fa4-b6a4-4ad9-a144-925cb091ee83 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.695630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c40fa4-b6a4-4ad9-a144-925cb091ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.714575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-16c40fa4-b6a4-4ad9-a144-925cb091ee83 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:17:44.715771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-16c40fa4-b6a4-4ad9-a144-925cb091ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:17:44.724070 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 574/1147] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:17:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:17:44.749784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e349275-b6fd-4cbb-b301-f0af046d3185 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:44.762085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e349275-b6fd-4cbb-b301-f0af046d3185 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:44.766442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:44.767819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.768095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.768366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.778726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:17:44.786537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:17:44.787747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 574/1148] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:17:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:44.793946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40fa4-b6a4-4ad9-a144-925cb091ee83 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:44.802915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c40fa4-b6a4-4ad9-a144-925cb091ee83 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:44.807418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:44.808096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.808380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.808655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.809423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:44.809731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:44.811348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:44.819851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 575/1149] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:17:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:44.825615 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:44.835621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e55b0a-ec45-472d-887e-d07fa45820a8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:44.840151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:44.840890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.841171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.841442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.851234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:44.853045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:44.869871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:44.877294 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 575/1150] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:17:44.878230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:44.888001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7881a-aeea-4807-994c-7fb21ebb67bc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:44.893342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:44.893985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.894298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.894578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.895321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:44.895630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:44.897206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:44.909198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 576/1151] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:44.916326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:44.926426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c33429-12f4-4745-b29d-6c1308e1b40c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:44.931064 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:44.931829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.932109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.932387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.939715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:44.941738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:44.955734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:17:44.956853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 576/1152] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:44 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:44.963771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:44.974321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ba0-d6d4-4225-a5b9-a13b490f1c48 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:44.979262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:44.980046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:44.980325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:44.980599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:44.981459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:44.981766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:44.983619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:45.000937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 577/1153] 10.222.0.11 () {56 vars in 1164 bytes} [Thu Nov 11 16:17:44 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:45.007892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:45.017448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961c974-de56-451d-8e9c-c6ed5865c0f9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:45.022010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:45.022664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:45.023003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:45.023284 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:45.031004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:45.033253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:45.042348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 577/1154] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:17:45 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:17:45.049817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:45.059203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7c62b-8aeb-4efa-a7a0-dbdb7217d2f8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:45.064126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:45.064902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:45.065186 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:45.065462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:45.075345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:45.077175 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:45.093955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:45.095658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 578/1155] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:45.101730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:45.111405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de651446-ab16-4cb9-a198-18e23cf8bddb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:45.116037 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:45.116673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:45.116955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:45.117237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:45.117971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:45.118319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:45.120055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:45.131684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 578/1156] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:45.138165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:45.148339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949bf4-e6bf-48fe-acf2-4992cafafcdc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:45.152879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:45.153643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:45.153928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:45.154228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:45.161006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:45.163030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:45.176555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:17:45.177721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 579/1157] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:17:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:45.184170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:45.194418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14038-b06d-4835-a803-eb70e650d202 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:45.198978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac2b7d-51c0-4067-8652-9b4fe29c9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:45.199609 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac2b7d-51c0-4067-8652-9b4fe29c9f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:45.199890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac2b7d-51c0-4067-8652-9b4fe29c9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:45.200163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac2b7d-51c0-4067-8652-9b4fe29c9f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:45.200966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac2b7d-51c0-4067-8652-9b4fe29c9f86 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:45.201272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac2b7d-51c0-4067-8652-9b4fe29c9f86 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:45.203143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac2b7d-51c0-4067-8652-9b4fe29c9f86 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:45.214884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 579/1158] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:17:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:45.221448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:45.232350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8f64-fd50-4a57-91d7-c74197b04edc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:45.237715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007345d-35b3-441e-b1a0-4de809f942cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:45.240216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007345d-35b3-441e-b1a0-4de809f942cb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:45.240216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007345d-35b3-441e-b1a0-4de809f942cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:45.240216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007345d-35b3-441e-b1a0-4de809f942cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:45.240216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007345d-35b3-441e-b1a0-4de809f942cb admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=c8a0c26778994b0c93541400cde47bc0) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:45.240216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007345d-35b3-441e-b1a0-4de809f942cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:45.241865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007345d-35b3-441e-b1a0-4de809f942cb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:45.247231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 580/1159] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:17:45 2021] GET /identity/v3/role_assignments?user.id=c8a0c26778994b0c93541400cde47bc0&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:47.446048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e3a0-5a2d-4261-9389-2ed6e67e1446 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.446657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e3a0-5a2d-4261-9389-2ed6e67e1446 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.446657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e3a0-5a2d-4261-9389-2ed6e67e1446 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.448463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 580/1160] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:17:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:17:47.454137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a5a9-e888-4bdb-9141-e2643d8114ad None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.454715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a5a9-e888-4bdb-9141-e2643d8114ad None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.454825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a5a9-e888-4bdb-9141-e2643d8114ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.472589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2dd5a5a9-e888-4bdb-9141-e2643d8114ad None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:17:47.473786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2dd5a5a9-e888-4bdb-9141-e2643d8114ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:17:47.481442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 581/1161] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:17:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:17:47.505884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e3a0-5a2d-4261-9389-2ed6e67e1446 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.518156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e3a0-5a2d-4261-9389-2ed6e67e1446 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.522442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.523204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.523481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.523752 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.533840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:17:47.540749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:17:47.541927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 581/1162] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:47.550455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a5a9-e888-4bdb-9141-e2643d8114ad None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.559416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a5a9-e888-4bdb-9141-e2643d8114ad None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.563987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.565276 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.565562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.565839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.566782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:47.567090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.568671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.576931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 582/1163] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:47.583511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.593654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc161a-a13f-454b-95cb-e7aa1524cb49 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.598284 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.602352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.602352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.602352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.609345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.611920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.628885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:47.631094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 582/1164] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:47.636459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.646588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdc896-84ac-4bd2-9baf-1cb168fac456 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.651203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.651855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.652141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.652419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.653243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:47.653558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.655177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.667439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 583/1165] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:47.673898 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.683630 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651535-424f-4869-8f53-c825bc65a69b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.688222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.689017 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.689343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.689761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.697128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.699131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.714046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:17:47.717264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 583/1166] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:47.723234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.732865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251b4c-13cb-4b2b-9e24-8c35d33c3d0d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.737412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.738062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.738387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.738665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.739520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:47.739829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.741653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.758598 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 584/1167] 10.222.0.11 () {56 vars in 1164 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:47.765213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.778045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17befa-868d-4d55-80ea-7c237440b464 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.784680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.785753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.786237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.786691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.798332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.800227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.817203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:47.818359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 584/1168] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:47.824439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.835422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be133e7-8531-4078-8f9a-6d335d8d64d3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.839972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.840625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.840910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.841187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.841935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:47.842274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.843861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.854817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 585/1169] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:47.861664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.871270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98db7d-665a-4bca-b7ab-f764cdad7fcc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.875783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.877047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.877810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.878090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.884989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.886975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.900607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:17:47.901756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 585/1170] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:47.908140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.917897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f0a2e-34cc-4313-8e35-267ee268157e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.922433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8e5b7-7bc8-4682-993e-869801648373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.923074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8e5b7-7bc8-4682-993e-869801648373 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.923360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8e5b7-7bc8-4682-993e-869801648373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.923718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8e5b7-7bc8-4682-993e-869801648373 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.924524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8e5b7-7bc8-4682-993e-869801648373 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:47.924839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8e5b7-7bc8-4682-993e-869801648373 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.926704 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8e5b7-7bc8-4682-993e-869801648373 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:47.938399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 586/1171] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:17:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:17:47.945616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:47.957808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce61a7e-0655-4561-9f64-948e2806ef5e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:47.962358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eb42e-3a3f-4e65-b68f-f005f32df62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:47.963188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb42e-3a3f-4e65-b68f-f005f32df62d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:47.963467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb42e-3a3f-4e65-b68f-f005f32df62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:47.963737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb42e-3a3f-4e65-b68f-f005f32df62d admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/c8a0c26778994b0c93541400cde47bc0/roles/2e5ce871831445568e7ab966da0a0812` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:47.978068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eb42e-3a3f-4e65-b68f-f005f32df62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=c8a0c26778994b0c93541400cde47bc0, role_id=2e5ce871831445568e7ab966da0a0812)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:47.980727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eb42e-3a3f-4e65-b68f-f005f32df62d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:48.155113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 586/1172] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:17:47 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/c8a0c26778994b0c93541400cde47bc0/roles/2e5ce871831445568e7ab966da0a0812 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:17:50.446946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b044e06-f2d9-4093-ab1c-ee4a5d1197c9 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.447546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b044e06-f2d9-4093-ab1c-ee4a5d1197c9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.447546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b044e06-f2d9-4093-ab1c-ee4a5d1197c9 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.449359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 587/1173] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:17:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:17:50.455329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b820-0721-43c9-aed2-58f15cfe9b75 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.455743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b820-0721-43c9-aed2-58f15cfe9b75 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.459559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b820-0721-43c9-aed2-58f15cfe9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.474383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3cf6b820-0721-43c9-aed2-58f15cfe9b75 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:17:50.475567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3cf6b820-0721-43c9-aed2-58f15cfe9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:17:50.533555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 587/1174] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:17:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:17:50.560292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b044e06-f2d9-4093-ab1c-ee4a5d1197c9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.573073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b044e06-f2d9-4093-ab1c-ee4a5d1197c9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.577503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.578693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.578977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.579398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.589480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:17:50.596514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:17:50.597669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 588/1175] 10.222.0.11 () {56 vars in 1123 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:50.604119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b820-0721-43c9-aed2-58f15cfe9b75 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.613620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b820-0721-43c9-aed2-58f15cfe9b75 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.618246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.618897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.619183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.619457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.620223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:50.620530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.622134 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.631029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 588/1176] 10.222.0.11 () {56 vars in 1124 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:50.637713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.647774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a94f4-bbe1-42d3-8b75-e808965d49b7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.652195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.652955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.653238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.653514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.663740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.665550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.682668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:50.683816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 589/1177] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:50.690112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.700451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548e821-3b1b-475f-ba6d-7493bdafbe25 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.704992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.705632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.706606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.706793 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.707533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:50.708939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.709426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.720780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 589/1178] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:50.728544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.738166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069454d6-d163-4754-826c-05e6ce8f6dd4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.742751 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.743539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.743819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.744090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.751159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.753900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.767308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:17:50.768963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 590/1179] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:50.775176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.785762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f8a3-0129-4437-9207-4fdb80792f84 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.790421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.791062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.791339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.791610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.792453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:50.792757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.794605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.811233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 590/1180] 10.222.0.11 () {56 vars in 1164 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:50.817989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.827423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97588647-1eab-4b1a-904c-38998082648f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.832875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.833499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.833789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.834069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.841926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.843699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.852418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 591/1181] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:17:50.858645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.868354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a9abc-b414-422e-81c6-10883d548fec admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.872976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.873741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.874028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.874346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.885043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.886900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.903517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:50.904644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 591/1182] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:50.910782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.919647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a6b1b-154f-4e39-9466-d5ad625a722f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.924417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.925063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.925341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.925617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.926386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:50.926690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.928238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.939262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 592/1183] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:50.946129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:50.955722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b1e3-7515-43b5-8156-f7c00357c676 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:50.961083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:50.961843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:50.962128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:50.962435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:50.969104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:50.971092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:50.984216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:17:50.985323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 592/1184] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:50.991828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:51.001213 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4f252-0130-4f28-ae58-b4258247de27 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:51.006778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaca526-cbcc-4bab-a165-32deb5c11698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:51.011958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca526-cbcc-4bab-a165-32deb5c11698 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:51.011958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca526-cbcc-4bab-a165-32deb5c11698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:51.011958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca526-cbcc-4bab-a165-32deb5c11698 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:51.011958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaca526-cbcc-4bab-a165-32deb5c11698 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:51.011958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaca526-cbcc-4bab-a165-32deb5c11698 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:51.011958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaca526-cbcc-4bab-a165-32deb5c11698 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:51.023620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 593/1185] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:17:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:51.031023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:51.041434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3665b2c-1fc5-4f19-9ed9-a6e045229815 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:51.045972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1d74-5a8b-4c02-a390-4ebe9590e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:51.046640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1d74-5a8b-4c02-a390-4ebe9590e5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:51.046923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1d74-5a8b-4c02-a390-4ebe9590e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:51.047201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1d74-5a8b-4c02-a390-4ebe9590e5a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:51.048042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1d74-5a8b-4c02-a390-4ebe9590e5a4 admin admin] RBAC: Adding query filter params (role.id=2e5ce871831445568e7ab966da0a0812, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=c8a0c26778994b0c93541400cde47bc0) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:51.048353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1d74-5a8b-4c02-a390-4ebe9590e5a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:51.050454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1d74-5a8b-4c02-a390-4ebe9590e5a4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:51.056236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 593/1186] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:17:51 2021] GET /identity/v3/role_assignments?user.id=c8a0c26778994b0c93541400cde47bc0&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=2e5ce871831445568e7ab966da0a0812 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:53.392522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c27e3-4749-42d8-8101-da21fef65e14 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.393074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c27e3-4749-42d8-8101-da21fef65e14 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.393074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c27e3-4749-42d8-8101-da21fef65e14 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.395656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 594/1187] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:17:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:17:53.401526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389666-9bb9-4608-b6ca-eca7141298a0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.401934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389666-9bb9-4608-b6ca-eca7141298a0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.402223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389666-9bb9-4608-b6ca-eca7141298a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.419986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-91389666-9bb9-4608-b6ca-eca7141298a0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:17:53.430442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-91389666-9bb9-4608-b6ca-eca7141298a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:17:53.430442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 594/1188] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:17:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:17:53.454727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c27e3-4749-42d8-8101-da21fef65e14 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.467611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c27e3-4749-42d8-8101-da21fef65e14 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.476923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.476923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.476923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.476923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.484450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:17:53.491386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:17:53.492539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 595/1189] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:53.498947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91389666-9bb9-4608-b6ca-eca7141298a0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.507882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91389666-9bb9-4608-b6ca-eca7141298a0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.512610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.513249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.513532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.513805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.514609 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:53.514914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.516516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.525319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 595/1190] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:53.531290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.542358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b84a9-7225-41d3-92ac-90aab7fd8ec2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.547729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.547729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.547935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.548151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.558620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.560434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.577027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:53.578198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 596/1191] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:17:53.584487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.593924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ab22-acf5-43fd-97da-923f10fd800e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.599273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.599273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.599273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.599577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.600258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:53.600566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.602143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.614060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 596/1192] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:53.621037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.631260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896a9a3-e025-4aab-b390-d86f67cedc70 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.636819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.636819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.637050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.637326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.644614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.646641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.660522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:17:53.661643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 597/1193] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:53.667983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.678227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103d02-1273-4da3-8763-29fae79c4968 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.682643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.683282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.683560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.683835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.684682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:53.684985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.686862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.704550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 597/1194] 10.222.0.11 () {56 vars in 1164 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:53.710594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.720005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9dcd9-6ad0-4563-8bfe-4b874345eb3c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.724654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.725281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.725565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.725844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.733455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.735279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.744511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 598/1195] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:17:53.750563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.761255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aaf07-9b8e-4f14-991f-d4244657fff5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.765718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.766509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.766790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.767059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.777047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.778894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.796427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:53.797562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 598/1196] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:53.804875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.813562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159de76-6c65-4d18-bf5b-c20c92204d8f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.818267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.818903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.819218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.819494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.820299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:53.820600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.822162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.833135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 599/1197] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:53.839158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.849280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccaffe4-88e6-4108-8021-09e77c3e7e86 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.853764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.854552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.854840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.855114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.861803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.864440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.877133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:17:53.878299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 599/1198] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:53.884653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.894772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115c4a3-9412-479f-8fad-95e57d3c0eb2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.899240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c7c86-d20b-4115-a231-0cbf665a9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.899913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7c86-d20b-4115-a231-0cbf665a9a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.900198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7c86-d20b-4115-a231-0cbf665a9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.900474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7c86-d20b-4115-a231-0cbf665a9a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.901278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c7c86-d20b-4115-a231-0cbf665a9a5d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:53.901597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c7c86-d20b-4115-a231-0cbf665a9a5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.903525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c7c86-d20b-4115-a231-0cbf665a9a5d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.917950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 600/1199] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:53.924489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:53.935679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877813d-c754-4ef5-a6c1-3ba3f9433202 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:53.940209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9501317-1117-467f-a814-c0759442ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:53.940919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9501317-1117-467f-a814-c0759442ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:53.941213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9501317-1117-467f-a814-c0759442ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:53.941481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9501317-1117-467f-a814-c0759442ac19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:53.942347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9501317-1117-467f-a814-c0759442ac19 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=c8a0c26778994b0c93541400cde47bc0) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:53.942657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9501317-1117-467f-a814-c0759442ac19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:53.944459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9501317-1117-467f-a814-c0759442ac19 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:53.949737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 600/1200] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:17:53 2021] GET /identity/v3/role_assignments?user.id=c8a0c26778994b0c93541400cde47bc0&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:56.226686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b131-26d0-4716-a79c-8635200cea01 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.227216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b131-26d0-4716-a79c-8635200cea01 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.227352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b131-26d0-4716-a79c-8635200cea01 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.229238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 601/1201] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:17:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:17:56.235075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a17ec-6c3d-4723-99eb-589c5740c2f6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.236395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a17ec-6c3d-4723-99eb-589c5740c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.236395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a17ec-6c3d-4723-99eb-589c5740c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.252676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ea6a17ec-6c3d-4723-99eb-589c5740c2f6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:17:56.254372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ea6a17ec-6c3d-4723-99eb-589c5740c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:17:56.262102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 601/1202] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:17:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:17:56.286746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b131-26d0-4716-a79c-8635200cea01 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.299153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b131-26d0-4716-a79c-8635200cea01 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.304402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.305176 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.305457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.305734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.315811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:17:56.323072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:17:56.324456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 602/1203] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:56.333030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a17ec-6c3d-4723-99eb-589c5740c2f6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.342331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a17ec-6c3d-4723-99eb-589c5740c2f6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.347080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.348430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.348565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.348797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.349556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:56.349861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.351587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.359774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 602/1204] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:56.366703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.376446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cdd44-9899-4219-a257-27512107b2e5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.381283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.382050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.382371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.382648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.393440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.396065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.413030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:56.414157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 603/1205] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:56.420453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.430014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e1b96-ae46-4963-ba45-c3da8763fff3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.434459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.435090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.435370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.435642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.436371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:56.436674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.438337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.449892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 603/1206] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:56.456001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.466095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b682-f0c6-4bcf-a2db-67ad1e19b042 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.470744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.471514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.471796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.472067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.480833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.482850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.496205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:17:56.497325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 604/1207] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:56.503468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.513465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8192b-5637-4258-8792-71ac18c5d36b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.518035 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.518721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.518999 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.519812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.520691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:56.520990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.522867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.541648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 604/1208] 10.222.0.11 () {56 vars in 1164 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:56.547943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.557870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd9c20-2005-443e-a04c-a8e9de99ae71 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.562359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.563161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.566491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.566491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.574467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.576294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.592839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:56.593992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 605/1209] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:56.601004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.610700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66625-dfd1-49a2-8b89-200b57eb0af3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.615676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.616324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.616605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.616883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.617622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:56.617929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.619567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.630894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 605/1210] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:56.637463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.647754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851f80a-cb1f-4355-99a5-ba3a6b027674 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.652247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.653073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.653358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.653636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.661065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.663047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.676523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:17:56.677652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 606/1211] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:56.684028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.693732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f77a9-7b91-4082-a3dc-3db4939d6eb0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.698497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b66e21-3e1b-43be-bb13-cef1200ad960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.699128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66e21-3e1b-43be-bb13-cef1200ad960 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.699410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66e21-3e1b-43be-bb13-cef1200ad960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.699684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66e21-3e1b-43be-bb13-cef1200ad960 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.700476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b66e21-3e1b-43be-bb13-cef1200ad960 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:56.700777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b66e21-3e1b-43be-bb13-cef1200ad960 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.702740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b66e21-3e1b-43be-bb13-cef1200ad960 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.715085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 606/1212] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:17:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:56.721452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:56.731683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9f9ad-f927-4266-a7f5-bcae9bfa3bb6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:56.736088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5dc7-0c41-4dae-89b8-b3d39f03d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:56.736946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5dc7-0c41-4dae-89b8-b3d39f03d0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:56.737230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5dc7-0c41-4dae-89b8-b3d39f03d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:56.737504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5dc7-0c41-4dae-89b8-b3d39f03d0bc admin admin] PATH_INFO: `/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/c8a0c26778994b0c93541400cde47bc0/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:56.739540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5dc7-0c41-4dae-89b8-b3d39f03d0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9addf7e974ac4c55a90334b0899c8a78, user_id=c8a0c26778994b0c93541400cde47bc0, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:56.742152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5dc7-0c41-4dae-89b8-b3d39f03d0bc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:56.844573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 607/1213] 10.222.0.11 () {58 vars in 1460 bytes} [Thu Nov 11 16:17:56 2021] PUT /identity/v3/projects/9addf7e974ac4c55a90334b0899c8a78/users/c8a0c26778994b0c93541400cde47bc0/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:17:59.078793 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da36d-1017-4091-9f2f-ae82a4f2ccdb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.079329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da36d-1017-4091-9f2f-ae82a4f2ccdb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.079329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da36d-1017-4091-9f2f-ae82a4f2ccdb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.081131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 607/1214] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:17:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:17:59.087547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea50eb1-e2fb-4e4a-9ee3-b162932bdb8a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.087931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea50eb1-e2fb-4e4a-9ee3-b162932bdb8a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.088105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea50eb1-e2fb-4e4a-9ee3-b162932bdb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.105590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3ea50eb1-e2fb-4e4a-9ee3-b162932bdb8a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:17:59.106810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3ea50eb1-e2fb-4e4a-9ee3-b162932bdb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:17:59.162035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 608/1215] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:17:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:17:59.187326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da36d-1017-4091-9f2f-ae82a4f2ccdb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.200431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da36d-1017-4091-9f2f-ae82a4f2ccdb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.204839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.205604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.205885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.206158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.217517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:17:59.224400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:17:59.225567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 608/1216] 10.222.0.11 () {56 vars in 1117 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:59.232257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea50eb1-e2fb-4e4a-9ee3-b162932bdb8a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.241174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea50eb1-e2fb-4e4a-9ee3-b162932bdb8a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.245680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.246357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.246639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.246911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.247675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:59.247977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.249607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.258512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 609/1217] 10.222.0.11 () {56 vars in 1120 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:59.264725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.274983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f526924-4216-4364-91da-188bdc9b83bc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.279564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.280329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.281360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.281360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.291329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.293155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.309790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:59.312172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 609/1218] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:59.318103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.327575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e43d7-d245-4044-97de-ade63eebbc5a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.332060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.333283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.333561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.333837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.334618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:59.334904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.336459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.347804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 610/1219] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:59.355370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.365136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e361b-c04a-4edd-876b-6968e40a193e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.369592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.370391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.370680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.370960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.378750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.381546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.395798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:17:59.397021 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 610/1220] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:59.403387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.413057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033d63-38b1-49f8-9825-54eaba77f3e8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.417566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.418234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.418516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.418788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.419633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:59.419935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.421775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.439182 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 611/1221] 10.222.0.11 () {56 vars in 1164 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:59.445893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.455404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c04fda-8e8b-4b75-aaca-a283bf6cc364 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.460450 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.461063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.461349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.461629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.469221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.471001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.480289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 611/1222] 10.222.0.11 () {58 vars in 1324 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:17:59.486372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.495814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e243a8a-50eb-44c2-b3aa-56d39756f386 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.500365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.501171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.501451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.501724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.512000 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.514021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.531025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:17:59.532218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 612/1223] 10.222.0.11 () {56 vars in 1129 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:17:59.539205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.548338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8a14-7736-4db9-b43c-76b571ca46ba admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.552937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.553577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.555261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.555261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.555261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:59.555261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.556806 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.568620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 612/1224] 10.222.0.11 () {56 vars in 1130 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:59.574749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.585154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a873e-9c7e-4cc9-9dc4-cb421a173166 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.589601 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.590410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.590696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.590975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.597639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.600351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.613173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:17:59.614439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 613/1225] 10.222.0.11 () {56 vars in 1132 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:17:59.620833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.630537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9838fb-f0bc-4786-94bd-f92aac3c386b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.635834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2332e-2056-4404-9677-2d8c72fdb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.636467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2332e-2056-4404-9677-2d8c72fdb116 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.636751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2332e-2056-4404-9677-2d8c72fdb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.637027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2332e-2056-4404-9677-2d8c72fdb116 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.637857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2332e-2056-4404-9677-2d8c72fdb116 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:59.638165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2332e-2056-4404-9677-2d8c72fdb116 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.640019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2332e-2056-4404-9677-2d8c72fdb116 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.652169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 613/1226] 10.222.0.11 () {56 vars in 1169 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:17:59.658645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:17:59.669296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e04f9-e284-4b1f-9cd2-bcdbd527c927 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:17:59.673831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2da13b-9852-4a87-b417-892862130c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:17:59.674488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2da13b-9852-4a87-b417-892862130c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:17:59.674775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2da13b-9852-4a87-b417-892862130c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:17:59.675052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2da13b-9852-4a87-b417-892862130c36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:17:59.675899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2da13b-9852-4a87-b417-892862130c36 admin admin] RBAC: Adding query filter params (role.id=08583b4d4b434a4594ee6864e55939c5, scope.project.id=9addf7e974ac4c55a90334b0899c8a78, user.id=c8a0c26778994b0c93541400cde47bc0) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:17:59.676712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2da13b-9852-4a87-b417-892862130c36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:17:59.678707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2da13b-9852-4a87-b417-892862130c36 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:17:59.684415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 614/1227] 10.222.0.11 () {56 vars in 1395 bytes} [Thu Nov 11 16:17:59 2021] GET /identity/v3/role_assignments?user.id=c8a0c26778994b0c93541400cde47bc0&scope.project.id=9addf7e974ac4c55a90334b0899c8a78&role.id=08583b4d4b434a4594ee6864e55939c5 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:18:01.989645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb77848-1596-4e6c-b5b8-8e68df770364 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:01.990172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb77848-1596-4e6c-b5b8-8e68df770364 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:01.990311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb77848-1596-4e6c-b5b8-8e68df770364 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:01.992008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 614/1228] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:18:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:18:01.997854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473688e2-b61c-4275-af37-d60dffac103a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:01.998252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473688e2-b61c-4275-af37-d60dffac103a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:01.998478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473688e2-b61c-4275-af37-d60dffac103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:02.016631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-473688e2-b61c-4275-af37-d60dffac103a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:18:02.017827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-473688e2-b61c-4275-af37-d60dffac103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:18:02.025697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 615/1229] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:18:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:18:02.049896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb77848-1596-4e6c-b5b8-8e68df770364 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:02.062771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb77848-1596-4e6c-b5b8-8e68df770364 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:02.067159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:02.068075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:02.068364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:02.068640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:02.069315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:02.070997 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:02.081677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 11 16:18:02.083054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 615/1230] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:18:02 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:18:02.090811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473688e2-b61c-4275-af37-d60dffac103a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:02.100396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473688e2-b61c-4275-af37-d60dffac103a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:02.104916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b5a5-1530-408c-a6a0-2aece5ee344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:02.105566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b5a5-1530-408c-a6a0-2aece5ee344c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:02.105853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b5a5-1530-408c-a6a0-2aece5ee344c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:02.106132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b5a5-1530-408c-a6a0-2aece5ee344c admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:02.106906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b5a5-1530-408c-a6a0-2aece5ee344c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:18:02.107215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b5a5-1530-408c-a6a0-2aece5ee344c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:02.108800 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b5a5-1530-408c-a6a0-2aece5ee344c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:02.113510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 616/1231] 10.222.0.11 () {56 vars in 1137 bytes} [Thu Nov 11 16:18:02 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:18:02.120233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:02.129955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563408b-eac1-4bf5-a295-827877bd307c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:02.134456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406ad84-8202-4e38-a6ae-959d4b625026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:02.135335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ad84-8202-4e38-a6ae-959d4b625026 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:02.135616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ad84-8202-4e38-a6ae-959d4b625026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:02.135888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ad84-8202-4e38-a6ae-959d4b625026 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:02.136599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406ad84-8202-4e38-a6ae-959d4b625026 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:18:02.136900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406ad84-8202-4e38-a6ae-959d4b625026 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:02.138494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406ad84-8202-4e38-a6ae-959d4b625026 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:02.142778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 616/1232] 10.222.0.11 () {56 vars in 1137 bytes} [Thu Nov 11 16:18:02 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:18:04.372346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80d644-3e66-43ba-be3f-119a9df4c06c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:04.372919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80d644-3e66-43ba-be3f-119a9df4c06c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:04.373016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80d644-3e66-43ba-be3f-119a9df4c06c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:04.374783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 617/1233] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:18:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:18:04.381133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddfae-c52e-4f04-bb6b-d69cc9b8822c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:04.381542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddfae-c52e-4f04-bb6b-d69cc9b8822c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:04.381683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddfae-c52e-4f04-bb6b-d69cc9b8822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:04.400364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5feddfae-c52e-4f04-bb6b-d69cc9b8822c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:18:04.401534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5feddfae-c52e-4f04-bb6b-d69cc9b8822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:18:04.409158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 617/1234] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:18:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:18:04.433773 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80d644-3e66-43ba-be3f-119a9df4c06c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:04.446763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80d644-3e66-43ba-be3f-119a9df4c06c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:04.451159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d8291-d922-465b-8fda-26f14bdbeeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:04.451806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8291-d922-465b-8fda-26f14bdbeeff admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:04.452093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8291-d922-465b-8fda-26f14bdbeeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:04.453313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d8291-d922-465b-8fda-26f14bdbeeff admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:04.453313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d8291-d922-465b-8fda-26f14bdbeeff admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:04.454728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d8291-d922-465b-8fda-26f14bdbeeff admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:04.566662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 618/1235] 10.222.0.11 () {60 vars in 1162 bytes} [Thu Nov 11 16:18:04 2021] POST /identity/v3/services => generated 246 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:18:06.837757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544918f-108b-4867-99bb-044582624f08 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:06.838301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544918f-108b-4867-99bb-044582624f08 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:06.838301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544918f-108b-4867-99bb-044582624f08 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:06.840028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 618/1236] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:18:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:18:06.845865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e2fd0-a51d-4831-bc42-2df09fbf269a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:06.846300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e2fd0-a51d-4831-bc42-2df09fbf269a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:06.846460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e2fd0-a51d-4831-bc42-2df09fbf269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:06.865565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3c8e2fd0-a51d-4831-bc42-2df09fbf269a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:18:06.866769 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3c8e2fd0-a51d-4831-bc42-2df09fbf269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:18:06.882787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 619/1237] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:18:06 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:18:06.909314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544918f-108b-4867-99bb-044582624f08 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:06.922169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544918f-108b-4867-99bb-044582624f08 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:06.926668 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:06.927814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:06.928106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:06.928387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:06.929310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:06.931072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:06.941719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 11 16:18:06.943180 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 619/1238] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:18:06 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:18:06.949816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e2fd0-a51d-4831-bc42-2df09fbf269a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:06.959629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e2fd0-a51d-4831-bc42-2df09fbf269a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:06.964197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:06.964917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:06.965205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:06.965484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:06.966254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:18:06.966567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:06.968155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:06.973226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 620/1239] 10.222.0.11 () {56 vars in 1137 bytes} [Thu Nov 11 16:18:06 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:18:06.980334 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:06.990000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa20df6-da29-432f-8255-b636b3dd6672 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:06.994632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c98391-8fd4-475a-b491-30c54bba9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:06.995265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c98391-8fd4-475a-b491-30c54bba9a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:06.999910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c98391-8fd4-475a-b491-30c54bba9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:06.999910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c98391-8fd4-475a-b491-30c54bba9a6b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:06.999910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c98391-8fd4-475a-b491-30c54bba9a6b admin admin] RBAC: Adding query filter params (interface=public, service_id=3e717251daa04fe197acc983b0864b71, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:18:06.999910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c98391-8fd4-475a-b491-30c54bba9a6b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:06.999910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c98391-8fd4-475a-b491-30c54bba9a6b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:07.003357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 620/1240] 10.222.0.11 () {56 vars in 1272 bytes} [Thu Nov 11 16:18:06 2021] GET /identity/v3/endpoints?service_id=3e717251daa04fe197acc983b0864b71&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:18:07.009668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:07.019427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee14cf-94fa-45c4-ba19-ce0d6e451d78 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:07.025021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fc569-08eb-4ff1-b459-698fb278b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:07.025657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc569-08eb-4ff1-b459-698fb278b190 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:07.025936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc569-08eb-4ff1-b459-698fb278b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:07.026238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fc569-08eb-4ff1-b459-698fb278b190 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:07.026926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fc569-08eb-4ff1-b459-698fb278b190 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:07.028472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fc569-08eb-4ff1-b459-698fb278b190 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:07.035170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 621/1241] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:18:07 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:18:09.299150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808fb5d-6ec0-485d-ae4e-7825422e4cd3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:09.299726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808fb5d-6ec0-485d-ae4e-7825422e4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:09.299726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808fb5d-6ec0-485d-ae4e-7825422e4cd3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:09.301472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 621/1242] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:18:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:18:09.307983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b46e3-0107-47ab-8faf-8177abc5301b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:09.308406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b46e3-0107-47ab-8faf-8177abc5301b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:09.308546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b46e3-0107-47ab-8faf-8177abc5301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:09.326927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-393b46e3-0107-47ab-8faf-8177abc5301b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:18:09.328126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-393b46e3-0107-47ab-8faf-8177abc5301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:18:09.335878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 622/1243] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:18:09 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:18:09.361675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808fb5d-6ec0-485d-ae4e-7825422e4cd3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:09.374459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808fb5d-6ec0-485d-ae4e-7825422e4cd3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:09.378919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:09.379685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:09.379968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:09.380243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:09.382003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:09.383737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:09.394811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 11 16:18:09.395918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 622/1244] 10.222.0.11 () {56 vars in 1138 bytes} [Thu Nov 11 16:18:09 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:18:09.402449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b46e3-0107-47ab-8faf-8177abc5301b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:09.411267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b46e3-0107-47ab-8faf-8177abc5301b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:09.415993 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2f42-1156-4cc0-a08f-50dcf7a9a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:09.416680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2f42-1156-4cc0-a08f-50dcf7a9a4ea admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:09.416965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2f42-1156-4cc0-a08f-50dcf7a9a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:09.417243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2f42-1156-4cc0-a08f-50dcf7a9a4ea admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:09.417973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2f42-1156-4cc0-a08f-50dcf7a9a4ea admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:18:09.418317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2f42-1156-4cc0-a08f-50dcf7a9a4ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:09.419891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2f42-1156-4cc0-a08f-50dcf7a9a4ea admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:09.425029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 623/1245] 10.222.0.11 () {56 vars in 1137 bytes} [Thu Nov 11 16:18:09 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:18:09.432360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:18:09.442717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8081e7-cf1a-43c6-80b4-8fbe983d30a3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:18:09.447831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533634cb-1ed7-4aa7-ac70-8a0d1e19d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:18:09.448459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533634cb-1ed7-4aa7-ac70-8a0d1e19d8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:18:09.448736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533634cb-1ed7-4aa7-ac70-8a0d1e19d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:18:09.449008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533634cb-1ed7-4aa7-ac70-8a0d1e19d8d7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:18:09.449764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533634cb-1ed7-4aa7-ac70-8a0d1e19d8d7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:18:09.451366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533634cb-1ed7-4aa7-ac70-8a0d1e19d8d7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:18:09.616579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 623/1246] 10.222.0.11 () {60 vars in 1165 bytes} [Thu Nov 11 16:18:09 2021] POST /identity/v3/endpoints => generated 331 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:24:35.113618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d3126-6476-4f17-bb43-f54a3608cf40 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:35.114221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d3126-6476-4f17-bb43-f54a3608cf40 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:35.114221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d3126-6476-4f17-bb43-f54a3608cf40 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:35.119039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 624/1247] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:35.122850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e148f0-b9a2-444a-a4ed-71e8f9d41c30 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:35.122850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e148f0-b9a2-444a-a4ed-71e8f9d41c30 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:35.123948 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e148f0-b9a2-444a-a4ed-71e8f9d41c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:35.209753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e2e148f0-b9a2-444a-a4ed-71e8f9d41c30 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:35.211483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e2e148f0-b9a2-444a-a4ed-71e8f9d41c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:35.331818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 624/1248] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:35.356287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d3126-6476-4f17-bb43-f54a3608cf40 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:35.358022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-332d3126-6476-4f17-bb43-f54a3608cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:35.494981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d3126-6476-4f17-bb43-f54a3608cf40 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:35.602964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28ee66-6e7b-4658-bbac-9da9f832ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:35.603533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28ee66-6e7b-4658-bbac-9da9f832ed61 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:35.603820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28ee66-6e7b-4658-bbac-9da9f832ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:35.604099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28ee66-6e7b-4658-bbac-9da9f832ed61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:35.604856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28ee66-6e7b-4658-bbac-9da9f832ed61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:35.607537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28ee66-6e7b-4658-bbac-9da9f832ed61 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:35.626662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 625/1249] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:24:35 2021] GET /identity/v3/projects => generated 2553 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:24:37.966811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374b1b-e3c4-490a-8bbc-4cf75f9ef294 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:37.967296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374b1b-e3c4-490a-8bbc-4cf75f9ef294 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:37.967389 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374b1b-e3c4-490a-8bbc-4cf75f9ef294 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:37.969181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 625/1250] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:37.975403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052bec0-3a20-42e7-a963-583702f6127f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:37.975826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052bec0-3a20-42e7-a963-583702f6127f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:37.976641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052bec0-3a20-42e7-a963-583702f6127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:38.060137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e052bec0-3a20-42e7-a963-583702f6127f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:38.061362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e052bec0-3a20-42e7-a963-583702f6127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:38.170230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 626/1251] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:24:38.227946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a600e-695e-405e-91b2-d812307106b3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:38.228239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a600e-695e-405e-91b2-d812307106b3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:38.228525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a600e-695e-405e-91b2-d812307106b3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:38.230347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 626/1252] 10.222.0.11 () {54 vars in 964 bytes} [Thu Nov 11 16:24:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:38.238488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211bdb-4680-421f-8e72-1b9001640607 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:38.238780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211bdb-4680-421f-8e72-1b9001640607 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:38.239059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211bdb-4680-421f-8e72-1b9001640607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:38.314603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c1211bdb-4680-421f-8e72-1b9001640607 None None] MFA Rules not processed for user `25123d6cb4fc417899321ecdb3c76b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:38.315809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c1211bdb-4680-421f-8e72-1b9001640607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:38.393194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 627/1253] 10.222.0.11 () {58 vars in 1061 bytes} [Thu Nov 11 16:24:38 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:38.403256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a600e-695e-405e-91b2-d812307106b3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:38.404953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-498a600e-695e-405e-91b2-d812307106b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:38.512074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a600e-695e-405e-91b2-d812307106b3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:38.593552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd916c-a1e1-439e-9054-72f905b7c910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:38.594251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd916c-a1e1-439e-9054-72f905b7c910 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:38.594526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd916c-a1e1-439e-9054-72f905b7c910 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:38.594804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd916c-a1e1-439e-9054-72f905b7c910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:38.596453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-26bd916c-a1e1-439e-9054-72f905b7c910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:38.706513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd916c-a1e1-439e-9054-72f905b7c910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:38.707981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd916c-a1e1-439e-9054-72f905b7c910 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:38.727144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 627/1254] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:24:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:24:41.297898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced6863-9e45-4296-a3d1-462dc2576aa9 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:41.298516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced6863-9e45-4296-a3d1-462dc2576aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:41.298516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced6863-9e45-4296-a3d1-462dc2576aa9 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:41.300302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 628/1255] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:41.306199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce871c22-168b-4378-9538-12b7378d00a5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:41.306643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce871c22-168b-4378-9538-12b7378d00a5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:41.306735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce871c22-168b-4378-9538-12b7378d00a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:41.369069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ce871c22-168b-4378-9538-12b7378d00a5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:41.370353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ce871c22-168b-4378-9538-12b7378d00a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:41.463186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 628/1256] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:41.520024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086733-b9ff-406d-8aa5-6eba2fa8646e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:41.520311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086733-b9ff-406d-8aa5-6eba2fa8646e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:41.520589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086733-b9ff-406d-8aa5-6eba2fa8646e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:41.522383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 629/1257] 10.222.0.11 () {54 vars in 964 bytes} [Thu Nov 11 16:24:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:41.528386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7b9f-edd0-4ce3-bd64-5ce7c5c927e6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:41.528673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7b9f-edd0-4ce3-bd64-5ce7c5c927e6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:41.528944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7b9f-edd0-4ce3-bd64-5ce7c5c927e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:41.601177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1e2f7b9f-edd0-4ce3-bd64-5ce7c5c927e6 None None] MFA Rules not processed for user `25123d6cb4fc417899321ecdb3c76b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:41.602340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1e2f7b9f-edd0-4ce3-bd64-5ce7c5c927e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:41.676465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 629/1258] 10.222.0.11 () {58 vars in 1061 bytes} [Thu Nov 11 16:24:41 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:41.686415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2086733-b9ff-406d-8aa5-6eba2fa8646e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:41.687982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f2086733-b9ff-406d-8aa5-6eba2fa8646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:41.788627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2086733-b9ff-406d-8aa5-6eba2fa8646e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:41.861516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079e931-e79c-4bd0-ab10-52b4420ff8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:41.862094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079e931-e79c-4bd0-ab10-52b4420ff8bc service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:41.862408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079e931-e79c-4bd0-ab10-52b4420ff8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:41.862685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079e931-e79c-4bd0-ab10-52b4420ff8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:41.864319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6079e931-e79c-4bd0-ab10-52b4420ff8bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:41.971508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079e931-e79c-4bd0-ab10-52b4420ff8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:41.972966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079e931-e79c-4bd0-ab10-52b4420ff8bc service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:41.990638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 630/1259] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:24:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:24:45.112956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6892-4947-49af-a8b9-8b8aa33e8957 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:45.113490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6892-4947-49af-a8b9-8b8aa33e8957 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:45.113490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d6892-4947-49af-a8b9-8b8aa33e8957 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:45.115334 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 630/1260] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:45.121236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:45.121615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:45.121816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:45.184563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:45.185776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:45.277290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 631/1261] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:45.315011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6892-4947-49af-a8b9-8b8aa33e8957 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:45.316528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-473d6892-4947-49af-a8b9-8b8aa33e8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:45.436959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d6892-4947-49af-a8b9-8b8aa33e8957 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:45.524761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7219cd2-711b-421e-b630-ad7a0c58066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:45.525599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219cd2-711b-421e-b630-ad7a0c58066e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:45.525880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219cd2-711b-421e-b630-ad7a0c58066e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:45.526154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7219cd2-711b-421e-b630-ad7a0c58066e admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:45.535708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7219cd2-711b-421e-b630-ad7a0c58066e admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:45.538116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7219cd2-711b-421e-b630-ad7a0c58066e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:45.539875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 631/1262] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:24:45 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:24:45.552909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:45.554117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:45.640388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c0b91-606f-4c43-b081-c625d725a0be None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:45.710454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c1e7a-38b0-4ee6-86a2-2d10fa9b0873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:45.711031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1e7a-38b0-4ee6-86a2-2d10fa9b0873 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:45.711317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1e7a-38b0-4ee6-86a2-2d10fa9b0873 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:45.711595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1e7a-38b0-4ee6-86a2-2d10fa9b0873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:45.713233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-539c1e7a-38b0-4ee6-86a2-2d10fa9b0873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:45.819487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c1e7a-38b0-4ee6-86a2-2d10fa9b0873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:45.820922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c1e7a-38b0-4ee6-86a2-2d10fa9b0873 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:45.838761 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 632/1263] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:24:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:24:48.884076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b502e-39f0-42e6-9d67-e7048ecc8722 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:48.884624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b502e-39f0-42e6-9d67-e7048ecc8722 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:48.884624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b502e-39f0-42e6-9d67-e7048ecc8722 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:48.886349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 632/1264] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:48.892319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:48.892745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:48.892877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:48.957387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:48.958638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:49.053338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 633/1265] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:49.090346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b502e-39f0-42e6-9d67-e7048ecc8722 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:49.092592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-558b502e-39f0-42e6-9d67-e7048ecc8722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:49.210322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b502e-39f0-42e6-9d67-e7048ecc8722 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:49.297780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab98b9c-dc39-4c07-9dfb-6e0977a0f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:49.298766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98b9c-dc39-4c07-9dfb-6e0977a0f34d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:49.299066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98b9c-dc39-4c07-9dfb-6e0977a0f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:49.299323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98b9c-dc39-4c07-9dfb-6e0977a0f34d admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:49.308701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab98b9c-dc39-4c07-9dfb-6e0977a0f34d admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:49.310832 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab98b9c-dc39-4c07-9dfb-6e0977a0f34d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:49.312527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 633/1266] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:24:49 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:24:49.324747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:49.326502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:49.411518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250df6-5c00-4f66-bfa2-5eb67dbd4562 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:49.480782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec84dc-f2ef-47e2-babe-ae62af135f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:49.481360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec84dc-f2ef-47e2-babe-ae62af135f57 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:49.482201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec84dc-f2ef-47e2-babe-ae62af135f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:49.482481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec84dc-f2ef-47e2-babe-ae62af135f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:49.484099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b7ec84dc-f2ef-47e2-babe-ae62af135f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:49.588481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec84dc-f2ef-47e2-babe-ae62af135f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:49.589918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec84dc-f2ef-47e2-babe-ae62af135f57 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:49.608892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 634/1267] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:24:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:24:52.932310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae649d4-d010-4ca9-9517-28d91e84e78f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:52.932847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae649d4-d010-4ca9-9517-28d91e84e78f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:52.932847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae649d4-d010-4ca9-9517-28d91e84e78f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:52.934757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 634/1268] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:52.941306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da528e5-cd24-4ca8-b703-b7c33c7a1d85 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:52.941733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da528e5-cd24-4ca8-b703-b7c33c7a1d85 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:52.941886 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da528e5-cd24-4ca8-b703-b7c33c7a1d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:53.005827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8da528e5-cd24-4ca8-b703-b7c33c7a1d85 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:53.007082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8da528e5-cd24-4ca8-b703-b7c33c7a1d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:53.113663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 635/1269] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:53.155205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae649d4-d010-4ca9-9517-28d91e84e78f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:53.156746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-dae649d4-d010-4ca9-9517-28d91e84e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:53.260286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae649d4-d010-4ca9-9517-28d91e84e78f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:53.333229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecb201-cdfc-44dd-b658-a01f8cddc848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:53.333972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb201-cdfc-44dd-b658-a01f8cddc848 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:53.334289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb201-cdfc-44dd-b658-a01f8cddc848 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:53.334566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb201-cdfc-44dd-b658-a01f8cddc848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:53.336255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e1ecb201-cdfc-44dd-b658-a01f8cddc848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:53.441161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecb201-cdfc-44dd-b658-a01f8cddc848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:53.442655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecb201-cdfc-44dd-b658-a01f8cddc848 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:53.459974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 635/1270] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:24:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:24:55.791745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf892-7599-45f1-921b-0100a1b886e4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:55.792113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf892-7599-45f1-921b-0100a1b886e4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:55.792282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbf892-7599-45f1-921b-0100a1b886e4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:55.794002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 636/1271] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:55.800576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb5b2-1bbc-4cba-b4a3-c81127ecfdfc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:55.800992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb5b2-1bbc-4cba-b4a3-c81127ecfdfc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:55.801270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb5b2-1bbc-4cba-b4a3-c81127ecfdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:55.867533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4c9bb5b2-1bbc-4cba-b4a3-c81127ecfdfc None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:55.868760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4c9bb5b2-1bbc-4cba-b4a3-c81127ecfdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:55.962504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 636/1272] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:56.001986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbf892-7599-45f1-921b-0100a1b886e4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:56.003708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8fcbf892-7599-45f1-921b-0100a1b886e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:56.101704 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbf892-7599-45f1-921b-0100a1b886e4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:56.172960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69913cd-09b6-4ce2-a4f5-2fe99292ada0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:56.173668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69913cd-09b6-4ce2-a4f5-2fe99292ada0 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:56.173959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69913cd-09b6-4ce2-a4f5-2fe99292ada0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:56.174279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69913cd-09b6-4ce2-a4f5-2fe99292ada0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:56.175925 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d69913cd-09b6-4ce2-a4f5-2fe99292ada0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:56.280548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69913cd-09b6-4ce2-a4f5-2fe99292ada0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:56.282029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69913cd-09b6-4ce2-a4f5-2fe99292ada0 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:56.300569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 637/1273] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:24:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:24:58.625081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a0a6-6800-49bb-8a77-678843bbe8c6 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:58.625606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a0a6-6800-49bb-8a77-678843bbe8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:58.625717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a0a6-6800-49bb-8a77-678843bbe8c6 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:58.627482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 637/1274] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:24:58.633486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:58.633891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:58.634057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:58.696964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:24:58.698154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:58.791445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 638/1275] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:24:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:24:58.827153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a0a6-6800-49bb-8a77-678843bbe8c6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:58.828703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-09b7a0a6-6800-49bb-8a77-678843bbe8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:58.954200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a0a6-6800-49bb-8a77-678843bbe8c6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:59.044019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861987a-7f52-4df1-9fda-226c4848127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:59.044823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861987a-7f52-4df1-9fda-226c4848127b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:59.045101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861987a-7f52-4df1-9fda-226c4848127b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:59.045374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861987a-7f52-4df1-9fda-226c4848127b admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:59.054763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861987a-7f52-4df1-9fda-226c4848127b admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:59.056846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861987a-7f52-4df1-9fda-226c4848127b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:59.058548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 638/1276] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:24:58 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:24:59.070607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:24:59.071809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:59.159313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2431485-c73b-464c-ae38-b0b64fa40b81 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:24:59.230088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf8f06-ce3f-4a6b-a0d0-98050ef90002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:24:59.230766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8f06-ce3f-4a6b-a0d0-98050ef90002 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:24:59.231044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8f06-ce3f-4a6b-a0d0-98050ef90002 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:24:59.231312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8f06-ce3f-4a6b-a0d0-98050ef90002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:24:59.233536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fcbf8f06-ce3f-4a6b-a0d0-98050ef90002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:24:59.335434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf8f06-ce3f-4a6b-a0d0-98050ef90002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:24:59.336779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf8f06-ce3f-4a6b-a0d0-98050ef90002 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:24:59.354767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 639/1277] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:24:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:25:02.327457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce41b1-3d4f-45da-a76a-b3d6717d68ea None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:02.327987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce41b1-3d4f-45da-a76a-b3d6717d68ea None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:02.327987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce41b1-3d4f-45da-a76a-b3d6717d68ea None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:02.329703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 639/1278] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:02.335559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064cd44-d298-4462-ba52-8b8f2223e883 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:02.335960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064cd44-d298-4462-ba52-8b8f2223e883 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:02.336127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064cd44-d298-4462-ba52-8b8f2223e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:02.398634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b064cd44-d298-4462-ba52-8b8f2223e883 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:02.399834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b064cd44-d298-4462-ba52-8b8f2223e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:02.491627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 640/1279] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:02.531323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce41b1-3d4f-45da-a76a-b3d6717d68ea None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:02.532858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7cce41b1-3d4f-45da-a76a-b3d6717d68ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:02.633086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce41b1-3d4f-45da-a76a-b3d6717d68ea None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:02.704443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736f3c2-ec7f-4f17-a5a6-db80722761a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:02.705081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736f3c2-ec7f-4f17-a5a6-db80722761a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:02.705363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736f3c2-ec7f-4f17-a5a6-db80722761a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:02.705637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736f3c2-ec7f-4f17-a5a6-db80722761a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:02.707403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6736f3c2-ec7f-4f17-a5a6-db80722761a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:02.811039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736f3c2-ec7f-4f17-a5a6-db80722761a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:02.812462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736f3c2-ec7f-4f17-a5a6-db80722761a8 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:02.829394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 640/1280] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:05.187594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bd5f9-90a7-472a-8d70-2c2ad443838f None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:05.188154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bd5f9-90a7-472a-8d70-2c2ad443838f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:05.188154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bd5f9-90a7-472a-8d70-2c2ad443838f None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:05.189940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 641/1281] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:05.196034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517462d-44b0-49d3-aee1-3ec91aa26427 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:05.196448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517462d-44b0-49d3-aee1-3ec91aa26427 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:05.196601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517462d-44b0-49d3-aee1-3ec91aa26427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:05.264766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b517462d-44b0-49d3-aee1-3ec91aa26427 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:05.265955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b517462d-44b0-49d3-aee1-3ec91aa26427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:05.368561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 641/1282] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:05.413177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bd5f9-90a7-472a-8d70-2c2ad443838f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:05.415348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-281bd5f9-90a7-472a-8d70-2c2ad443838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:05.507226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bd5f9-90a7-472a-8d70-2c2ad443838f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:05.510963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad19dfb-046f-49cc-84bc-37af9e239cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:05.511599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad19dfb-046f-49cc-84bc-37af9e239cec service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:05.511884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad19dfb-046f-49cc-84bc-37af9e239cec service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:05.512164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad19dfb-046f-49cc-84bc-37af9e239cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:05.521299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad19dfb-046f-49cc-84bc-37af9e239cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:05.522750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad19dfb-046f-49cc-84bc-37af9e239cec service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:05.531798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 642/1283] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:08.484478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf55f8-20f7-4a9d-b3b7-75212cece774 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:08.485002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf55f8-20f7-4a9d-b3b7-75212cece774 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:08.485121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf55f8-20f7-4a9d-b3b7-75212cece774 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:08.486834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 642/1284] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:08.492627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fa6c-8e90-4efe-8445-87763f9f5f38 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:08.493023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fa6c-8e90-4efe-8445-87763f9f5f38 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:08.493199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12fa6c-8e90-4efe-8445-87763f9f5f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:08.511329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ef12fa6c-8e90-4efe-8445-87763f9f5f38 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:08.512511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ef12fa6c-8e90-4efe-8445-87763f9f5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:08.520298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 643/1285] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:08.558775 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf55f8-20f7-4a9d-b3b7-75212cece774 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:08.569044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf55f8-20f7-4a9d-b3b7-75212cece774 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:08.572498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f0fa2-c28d-4b7d-8403-0d4126129fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:08.573113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f0fa2-c28d-4b7d-8403-0d4126129fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:08.573393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f0fa2-c28d-4b7d-8403-0d4126129fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:08.573663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f0fa2-c28d-4b7d-8403-0d4126129fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:08.582812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f0fa2-c28d-4b7d-8403-0d4126129fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:08.584254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f0fa2-c28d-4b7d-8403-0d4126129fd3 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:08.593804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 643/1286] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:13.152241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1371ca-c38b-47b9-bc8b-eeb993ab989e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:13.152759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1371ca-c38b-47b9-bc8b-eeb993ab989e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:13.152852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1371ca-c38b-47b9-bc8b-eeb993ab989e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:13.155561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 644/1287] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:13.161611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ffa2-8898-4d47-aab4-39a9002acab5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:13.162040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ffa2-8898-4d47-aab4-39a9002acab5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:13.162168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ffa2-8898-4d47-aab4-39a9002acab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:13.181412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c374ffa2-8898-4d47-aab4-39a9002acab5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:13.182642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c374ffa2-8898-4d47-aab4-39a9002acab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:13.190813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 644/1288] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:13.233985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1371ca-c38b-47b9-bc8b-eeb993ab989e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:13.244566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1371ca-c38b-47b9-bc8b-eeb993ab989e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:13.248288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efe7e-f45f-4bcb-b485-8e4d7c2e0b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:13.248926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efe7e-f45f-4bcb-b485-8e4d7c2e0b25 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:13.249206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efe7e-f45f-4bcb-b485-8e4d7c2e0b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:13.249476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efe7e-f45f-4bcb-b485-8e4d7c2e0b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:13.258481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efe7e-f45f-4bcb-b485-8e4d7c2e0b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:13.259897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efe7e-f45f-4bcb-b485-8e4d7c2e0b25 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:13.269590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 645/1289] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:16.614240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bf1a3-4682-4ac9-9f0a-a6155a49ab6a None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:16.614783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bf1a3-4682-4ac9-9f0a-a6155a49ab6a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:16.614783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bf1a3-4682-4ac9-9f0a-a6155a49ab6a None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:16.616652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 645/1290] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:16.623224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec93f4-e429-42ad-b65b-4c45a76fb17a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:16.623633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec93f4-e429-42ad-b65b-4c45a76fb17a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:16.623798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec93f4-e429-42ad-b65b-4c45a76fb17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:16.642681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c8ec93f4-e429-42ad-b65b-4c45a76fb17a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:16.643874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c8ec93f4-e429-42ad-b65b-4c45a76fb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:16.651643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 646/1291] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:16.691210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bf1a3-4682-4ac9-9f0a-a6155a49ab6a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:16.703101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bf1a3-4682-4ac9-9f0a-a6155a49ab6a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:16.706682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005da7c-2408-4ffc-8999-97227396de77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:16.707321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005da7c-2408-4ffc-8999-97227396de77 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:16.707601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005da7c-2408-4ffc-8999-97227396de77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:16.707875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005da7c-2408-4ffc-8999-97227396de77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:16.718085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005da7c-2408-4ffc-8999-97227396de77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:16.719589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005da7c-2408-4ffc-8999-97227396de77 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:16.730389 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 646/1292] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:21.238733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a200b9-c39e-4805-87fe-2532632b10e5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:21.239668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a200b9-c39e-4805-87fe-2532632b10e5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:21.239941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a200b9-c39e-4805-87fe-2532632b10e5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:21.241873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 647/1293] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:21.249979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124e75-1dd9-4c58-9c6b-157a6561cc71 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:21.250990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124e75-1dd9-4c58-9c6b-157a6561cc71 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:21.251263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24124e75-1dd9-4c58-9c6b-157a6561cc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:21.270971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-24124e75-1dd9-4c58-9c6b-157a6561cc71 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:21.272400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-24124e75-1dd9-4c58-9c6b-157a6561cc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:21.280911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 647/1294] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:21.325562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a200b9-c39e-4805-87fe-2532632b10e5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:21.336054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a200b9-c39e-4805-87fe-2532632b10e5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:21.339564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92873bf7-48d1-4241-981b-21d145ee3d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:21.340198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92873bf7-48d1-4241-981b-21d145ee3d75 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:21.340481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92873bf7-48d1-4241-981b-21d145ee3d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:21.340758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92873bf7-48d1-4241-981b-21d145ee3d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:21.350015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92873bf7-48d1-4241-981b-21d145ee3d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:21.352631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92873bf7-48d1-4241-981b-21d145ee3d75 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:21.361326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 648/1295] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:26.313670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8578-0002-47db-b69b-315f548fe006 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:26.315250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8578-0002-47db-b69b-315f548fe006 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:26.315688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8578-0002-47db-b69b-315f548fe006 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:26.317621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 648/1296] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:25:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:26.324360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609120af-4163-44f3-8800-8f3387625ad3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:26.325961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609120af-4163-44f3-8800-8f3387625ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:26.326542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609120af-4163-44f3-8800-8f3387625ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:26.412446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-609120af-4163-44f3-8800-8f3387625ad3 None None] MFA Rules not processed for user `c8a0c26778994b0c93541400cde47bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:26.414056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-609120af-4163-44f3-8800-8f3387625ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:26.512237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 649/1297] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:25:26 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:30.727387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085136a-8951-4443-acaf-7c131cde43c2 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:30.728296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085136a-8951-4443-acaf-7c131cde43c2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:30.728697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085136a-8951-4443-acaf-7c131cde43c2 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:30.730585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 649/1298] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:25:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:30.736520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d16e80-ea0b-4d39-a90e-fb1937549a44 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:30.736981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d16e80-ea0b-4d39-a90e-fb1937549a44 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:30.737077 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d16e80-ea0b-4d39-a90e-fb1937549a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:30.755948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a3d16e80-ea0b-4d39-a90e-fb1937549a44 None None] MFA Rules not processed for user `c8a0c26778994b0c93541400cde47bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:30.757174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a3d16e80-ea0b-4d39-a90e-fb1937549a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:30.766156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 650/1299] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:25:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:32.281696 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea041f-a287-488e-bbcc-9db5c8b9de64 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:32.282245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea041f-a287-488e-bbcc-9db5c8b9de64 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:32.282597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea041f-a287-488e-bbcc-9db5c8b9de64 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:32.284508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 650/1300] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:25:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:32.290706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63355-9422-4b4f-ac9b-d3072fdb6731 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:32.291137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63355-9422-4b4f-ac9b-d3072fdb6731 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:32.291318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63355-9422-4b4f-ac9b-d3072fdb6731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:32.309926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-def63355-9422-4b4f-ac9b-d3072fdb6731 None None] MFA Rules not processed for user `c8a0c26778994b0c93541400cde47bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:32.312265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-def63355-9422-4b4f-ac9b-d3072fdb6731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:32.321686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 651/1301] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:25:32 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:36.112280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7dbd0-93dc-4189-9036-814b359f7ce0 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:36.112773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7dbd0-93dc-4189-9036-814b359f7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:36.112773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7dbd0-93dc-4189-9036-814b359f7ce0 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:36.114527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 651/1302] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:36.120466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28fdd-fbbd-43e8-bfe9-895ff70fb69b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:36.120874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28fdd-fbbd-43e8-bfe9-895ff70fb69b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:36.121041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28fdd-fbbd-43e8-bfe9-895ff70fb69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:36.140648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-06a28fdd-fbbd-43e8-bfe9-895ff70fb69b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:36.142171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-06a28fdd-fbbd-43e8-bfe9-895ff70fb69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:36.151220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 652/1303] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:36.204343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46a7e-9173-4b3c-810c-a421abc16ca8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:36.204753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46a7e-9173-4b3c-810c-a421abc16ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:36.205265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46a7e-9173-4b3c-810c-a421abc16ca8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:36.207251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 652/1304] 10.222.0.11 () {54 vars in 961 bytes} [Thu Nov 11 16:25:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:36.213333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e81af-1d3d-4603-950a-9ef88d12245d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:36.213743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e81af-1d3d-4603-950a-9ef88d12245d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:36.214123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e81af-1d3d-4603-950a-9ef88d12245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:36.266597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7c6e81af-1d3d-4603-950a-9ef88d12245d None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:36.267799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7c6e81af-1d3d-4603-950a-9ef88d12245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:36.355488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 653/1305] 10.222.0.11 () {58 vars in 1058 bytes} [Thu Nov 11 16:25:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:36.365560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c46a7e-9173-4b3c-810c-a421abc16ca8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:36.380924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c46a7e-9173-4b3c-810c-a421abc16ca8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:36.386455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390465a9-a139-4c67-9150-22637aab67de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:36.387094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390465a9-a139-4c67-9150-22637aab67de service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:36.387380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390465a9-a139-4c67-9150-22637aab67de service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:36.387661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390465a9-a139-4c67-9150-22637aab67de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:36.397555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390465a9-a139-4c67-9150-22637aab67de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:36.399165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390465a9-a139-4c67-9150-22637aab67de service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:36.410606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 653/1306] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:25:39.035727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196350-cb61-4c9d-bdc5-e08147071f9a None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:39.036567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196350-cb61-4c9d-bdc5-e08147071f9a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:39.037004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be196350-cb61-4c9d-bdc5-e08147071f9a None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:39.039320 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 654/1307] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:39.045942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eeb2f-3dca-4378-a453-09d62ec2dcc1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:39.046437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eeb2f-3dca-4378-a453-09d62ec2dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:39.046604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eeb2f-3dca-4378-a453-09d62ec2dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:39.064215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-908eeb2f-3dca-4378-a453-09d62ec2dcc1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:39.065376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-908eeb2f-3dca-4378-a453-09d62ec2dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:39.073564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 654/1308] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:39.124358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be196350-cb61-4c9d-bdc5-e08147071f9a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:39.140204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be196350-cb61-4c9d-bdc5-e08147071f9a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:39.145953 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3010b4d-f024-48f8-a2ba-9fbd542168cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:39.146584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010b4d-f024-48f8-a2ba-9fbd542168cf service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:39.146873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010b4d-f024-48f8-a2ba-9fbd542168cf service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:39.147152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010b4d-f024-48f8-a2ba-9fbd542168cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:39.156614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010b4d-f024-48f8-a2ba-9fbd542168cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:39.158281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010b4d-f024-48f8-a2ba-9fbd542168cf service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:39.169174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 655/1309] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:42.004391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410f1c1-99f5-4b3c-98e7-dd97ffa3c76e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:42.004926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410f1c1-99f5-4b3c-98e7-dd97ffa3c76e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:42.005230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410f1c1-99f5-4b3c-98e7-dd97ffa3c76e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:42.007168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 655/1310] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:42.013532 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9fde4-9b12-4bfd-bd45-9fbb28287a0e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:42.014030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9fde4-9b12-4bfd-bd45-9fbb28287a0e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:42.014418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9fde4-9b12-4bfd-bd45-9fbb28287a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:42.033552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6ce9fde4-9b12-4bfd-bd45-9fbb28287a0e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:42.035121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6ce9fde4-9b12-4bfd-bd45-9fbb28287a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:42.043912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 656/1311] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:42.094568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98c038-b096-49b3-bc93-f0855fbf6c98 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:42.094855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98c038-b096-49b3-bc93-f0855fbf6c98 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:42.095350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98c038-b096-49b3-bc93-f0855fbf6c98 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:42.097152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 656/1312] 10.222.0.11 () {54 vars in 961 bytes} [Thu Nov 11 16:25:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:42.102986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a947-4f0e-4265-9b86-cfffa6aaf782 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:42.103285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a947-4f0e-4265-9b86-cfffa6aaf782 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:42.103568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a947-4f0e-4265-9b86-cfffa6aaf782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:42.126148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e839a947-4f0e-4265-9b86-cfffa6aaf782 None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:42.127398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e839a947-4f0e-4265-9b86-cfffa6aaf782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:42.137725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 657/1313] 10.222.0.11 () {58 vars in 1058 bytes} [Thu Nov 11 16:25:42 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:42.146509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98c038-b096-49b3-bc93-f0855fbf6c98 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:42.161889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98c038-b096-49b3-bc93-f0855fbf6c98 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:42.169079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f2af-9aea-4f5e-9959-6c26c2b396c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:42.169079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f2af-9aea-4f5e-9959-6c26c2b396c4 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:42.169079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f2af-9aea-4f5e-9959-6c26c2b396c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:42.169079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f2af-9aea-4f5e-9959-6c26c2b396c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:42.178529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f2af-9aea-4f5e-9959-6c26c2b396c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:42.180242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f2af-9aea-4f5e-9959-6c26c2b396c4 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:42.190196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 657/1314] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:44.058165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92702486-48a4-46af-a312-9eca9d8d2ee5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.058722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92702486-48a4-46af-a312-9eca9d8d2ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.058722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92702486-48a4-46af-a312-9eca9d8d2ee5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.060526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 658/1315] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:44.067343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81cfc-6d99-4abe-a8d3-a32ed4b4d685 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.068150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81cfc-6d99-4abe-a8d3-a32ed4b4d685 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.068431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81cfc-6d99-4abe-a8d3-a32ed4b4d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.086659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ebe81cfc-6d99-4abe-a8d3-a32ed4b4d685 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:44.087767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ebe81cfc-6d99-4abe-a8d3-a32ed4b4d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:44.101344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 658/1316] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:44.150770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67229f6-3f31-4190-8f5c-74c1a73b275f None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.151065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67229f6-3f31-4190-8f5c-74c1a73b275f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.151348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67229f6-3f31-4190-8f5c-74c1a73b275f None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.153298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 659/1317] 10.222.0.11 () {54 vars in 962 bytes} [Thu Nov 11 16:25:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:44.158483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea0249-2f15-4463-9c1a-acbc3e214790 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.158774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea0249-2f15-4463-9c1a-acbc3e214790 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.159061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea0249-2f15-4463-9c1a-acbc3e214790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.209030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c0ea0249-2f15-4463-9c1a-acbc3e214790 None None] MFA Rules not processed for user `a90779e40db745b3ba36fe213880bb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:44.210310 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c0ea0249-2f15-4463-9c1a-acbc3e214790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:44.281526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 659/1318] 10.222.0.11 () {58 vars in 1059 bytes} [Thu Nov 11 16:25:44 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:44.286107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67229f6-3f31-4190-8f5c-74c1a73b275f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:44.298927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67229f6-3f31-4190-8f5c-74c1a73b275f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:44.302703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896dbc-e922-4cf6-8e2e-29bfb9ef7e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:44.303355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896dbc-e922-4cf6-8e2e-29bfb9ef7e30 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.303668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896dbc-e922-4cf6-8e2e-29bfb9ef7e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.304132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896dbc-e922-4cf6-8e2e-29bfb9ef7e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.314816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896dbc-e922-4cf6-8e2e-29bfb9ef7e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:44.316272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896dbc-e922-4cf6-8e2e-29bfb9ef7e30 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:44.325642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 660/1319] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:44.742842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd470d-0ce2-492c-9186-3275d5e5ee45 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.743123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd470d-0ce2-492c-9186-3275d5e5ee45 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.743444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd470d-0ce2-492c-9186-3275d5e5ee45 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.746046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 660/1320] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:44.753372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ecc7-6539-43d4-aabb-34ecc07dd7ad None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.753805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ecc7-6539-43d4-aabb-34ecc07dd7ad None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.754207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ecc7-6539-43d4-aabb-34ecc07dd7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.773223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6711ecc7-6539-43d4-aabb-34ecc07dd7ad None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:44.774616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6711ecc7-6539-43d4-aabb-34ecc07dd7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:44.782754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 661/1321] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:44.833193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd470d-0ce2-492c-9186-3275d5e5ee45 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:44.849869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd470d-0ce2-492c-9186-3275d5e5ee45 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:44.855549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc2d44-ba22-4cf3-9bb1-cab820135533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:44.856187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2d44-ba22-4cf3-9bb1-cab820135533 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:44.856529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2d44-ba22-4cf3-9bb1-cab820135533 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:44.857040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2d44-ba22-4cf3-9bb1-cab820135533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:44.866436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc2d44-ba22-4cf3-9bb1-cab820135533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:44.868103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc2d44-ba22-4cf3-9bb1-cab820135533 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:44.879879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 661/1322] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:47.418216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fd4de-86de-4893-a846-7ac4d20c0501 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:47.418708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fd4de-86de-4893-a846-7ac4d20c0501 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:47.418708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fd4de-86de-4893-a846-7ac4d20c0501 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:47.421063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 662/1323] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:47.427070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a047eef-f1c2-4aea-abb9-455f7a994346 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:47.427457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a047eef-f1c2-4aea-abb9-455f7a994346 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:47.427623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a047eef-f1c2-4aea-abb9-455f7a994346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:47.444965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7a047eef-f1c2-4aea-abb9-455f7a994346 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:47.446149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7a047eef-f1c2-4aea-abb9-455f7a994346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:47.454273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 662/1324] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:47.503657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fd4de-86de-4893-a846-7ac4d20c0501 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:47.518153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fd4de-86de-4893-a846-7ac4d20c0501 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:47.523647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15195cd8-640a-42b2-a4b7-cb65bba1980c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:47.524287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195cd8-640a-42b2-a4b7-cb65bba1980c service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:47.524576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195cd8-640a-42b2-a4b7-cb65bba1980c service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:47.524857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195cd8-640a-42b2-a4b7-cb65bba1980c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:47.533784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15195cd8-640a-42b2-a4b7-cb65bba1980c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:47.535553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15195cd8-640a-42b2-a4b7-cb65bba1980c service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:47.546890 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 663/1325] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:50.079885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c4b3-bb59-4829-a25a-d5ea3125cf17 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:50.080848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c4b3-bb59-4829-a25a-d5ea3125cf17 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:50.081301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c4b3-bb59-4829-a25a-d5ea3125cf17 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:50.083482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 663/1326] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:25:50.089630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402ceb-28cb-44b5-b881-5eb25ce7726b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:50.090050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402ceb-28cb-44b5-b881-5eb25ce7726b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:50.090349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402ceb-28cb-44b5-b881-5eb25ce7726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:50.112217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-14402ceb-28cb-44b5-b881-5eb25ce7726b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:50.113767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-14402ceb-28cb-44b5-b881-5eb25ce7726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:50.126266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 664/1327] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:50.174876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c4b3-bb59-4829-a25a-d5ea3125cf17 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:50.196672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c4b3-bb59-4829-a25a-d5ea3125cf17 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:50.202491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790e1ea-1096-4364-a9e6-09503e09757a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:50.203204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790e1ea-1096-4364-a9e6-09503e09757a service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:50.203555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790e1ea-1096-4364-a9e6-09503e09757a service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:50.203893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790e1ea-1096-4364-a9e6-09503e09757a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:50.212718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790e1ea-1096-4364-a9e6-09503e09757a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:50.214442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790e1ea-1096-4364-a9e6-09503e09757a service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:50.225024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 664/1328] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:52.780838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b439e-f9a0-4a44-a74b-2ea23e05d076 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:52.782492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b439e-f9a0-4a44-a74b-2ea23e05d076 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:52.782492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b439e-f9a0-4a44-a74b-2ea23e05d076 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:52.783869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 665/1329] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:52.790306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2c9a8-57dd-418b-b479-0ba542d39f1f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:52.790960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2c9a8-57dd-418b-b479-0ba542d39f1f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:52.790960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2c9a8-57dd-418b-b479-0ba542d39f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:52.808429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b0d2c9a8-57dd-418b-b479-0ba542d39f1f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:52.809632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b0d2c9a8-57dd-418b-b479-0ba542d39f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:52.817663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 665/1330] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:52.868747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b439e-f9a0-4a44-a74b-2ea23e05d076 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:52.882853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b439e-f9a0-4a44-a74b-2ea23e05d076 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:52.888271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834b24b-57de-43bb-b597-bfa83e7f6f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:52.888909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834b24b-57de-43bb-b597-bfa83e7f6f5c service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:52.889196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834b24b-57de-43bb-b597-bfa83e7f6f5c service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:52.889475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834b24b-57de-43bb-b597-bfa83e7f6f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:52.898512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834b24b-57de-43bb-b597-bfa83e7f6f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:52.900102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834b24b-57de-43bb-b597-bfa83e7f6f5c service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:52.910401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 666/1331] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:55.284079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46604-1a46-4f91-b97e-6065efc0e905 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:55.284768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46604-1a46-4f91-b97e-6065efc0e905 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:55.284768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46604-1a46-4f91-b97e-6065efc0e905 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:55.286462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 666/1332] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:55.292660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3fa78-2cd2-4a8f-be93-02032246c6a8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:55.293272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3fa78-2cd2-4a8f-be93-02032246c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:55.293272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3fa78-2cd2-4a8f-be93-02032246c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:55.311150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-32e3fa78-2cd2-4a8f-be93-02032246c6a8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:55.312361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-32e3fa78-2cd2-4a8f-be93-02032246c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:55.320348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 667/1333] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:25:55.369015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46604-1a46-4f91-b97e-6065efc0e905 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:55.387208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46604-1a46-4f91-b97e-6065efc0e905 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:55.394800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f50527-79f7-4fe6-b762-bf1071595fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:55.395634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f50527-79f7-4fe6-b762-bf1071595fb4 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:55.395993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f50527-79f7-4fe6-b762-bf1071595fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:55.396342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f50527-79f7-4fe6-b762-bf1071595fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:55.407850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f50527-79f7-4fe6-b762-bf1071595fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:55.410165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f50527-79f7-4fe6-b762-bf1071595fb4 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:55.423150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 667/1334] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:57.885769 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9a33-3115-46b0-a8f4-150039c5b241 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:57.886303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9a33-3115-46b0-a8f4-150039c5b241 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:57.886398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9a33-3115-46b0-a8f4-150039c5b241 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:57.888164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 668/1335] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:25:57.894486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a13fe-e755-4933-8cbf-c4114c2fb475 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:57.894934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a13fe-e755-4933-8cbf-c4114c2fb475 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:57.895028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a13fe-e755-4933-8cbf-c4114c2fb475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:57.913076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-688a13fe-e755-4933-8cbf-c4114c2fb475 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:57.914275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-688a13fe-e755-4933-8cbf-c4114c2fb475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:57.922788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 668/1336] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:25:57.969590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9a33-3115-46b0-a8f4-150039c5b241 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:25:57.983713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9a33-3115-46b0-a8f4-150039c5b241 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:25:57.989944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b3ba-2a16-478a-8447-1801678e36d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:25:57.990608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b3ba-2a16-478a-8447-1801678e36d3 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:57.990888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b3ba-2a16-478a-8447-1801678e36d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:57.991158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b3ba-2a16-478a-8447-1801678e36d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:57.999305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72b3ba-2a16-478a-8447-1801678e36d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:25:58.000952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72b3ba-2a16-478a-8447-1801678e36d3 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:25:58.010119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 669/1337] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:25:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:25:59.944519 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255969-1ff9-40c6-838c-bc37fdd9753c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:59.945072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255969-1ff9-40c6-838c-bc37fdd9753c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:59.945072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5255969-1ff9-40c6-838c-bc37fdd9753c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:59.947171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 669/1338] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:25:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:25:59.954202 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51d811-190f-4eff-bcf3-7a39063cd047 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:25:59.954617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51d811-190f-4eff-bcf3-7a39063cd047 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:25:59.954761 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51d811-190f-4eff-bcf3-7a39063cd047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:25:59.972555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ff51d811-190f-4eff-bcf3-7a39063cd047 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:25:59.973753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ff51d811-190f-4eff-bcf3-7a39063cd047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:25:59.981469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 670/1339] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:25:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:00.042765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c211a-af3f-42e6-8186-e94624a2d162 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:00.043057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c211a-af3f-42e6-8186-e94624a2d162 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:00.043338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c211a-af3f-42e6-8186-e94624a2d162 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:00.045135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 670/1340] 10.222.0.11 () {54 vars in 962 bytes} [Thu Nov 11 16:26:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:00.050599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8baf1-9174-4b9d-9b13-70389bf61d9e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:00.050906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8baf1-9174-4b9d-9b13-70389bf61d9e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:00.051206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8baf1-9174-4b9d-9b13-70389bf61d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:00.099070 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e8f8baf1-9174-4b9d-9b13-70389bf61d9e None None] MFA Rules not processed for user `0d63f82b065248d68fe044e9de8b7b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:00.100191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e8f8baf1-9174-4b9d-9b13-70389bf61d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:00.158661 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 671/1341] 10.222.0.11 () {58 vars in 1059 bytes} [Thu Nov 11 16:26:00 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:00.166959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c211a-af3f-42e6-8186-e94624a2d162 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:00.177644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c211a-af3f-42e6-8186-e94624a2d162 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:00.181173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac6af9-7d41-4fd4-b73d-0c7b2f66ee35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:00.181801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6af9-7d41-4fd4-b73d-0c7b2f66ee35 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:00.182086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6af9-7d41-4fd4-b73d-0c7b2f66ee35 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:00.182408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6af9-7d41-4fd4-b73d-0c7b2f66ee35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:00.191892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac6af9-7d41-4fd4-b73d-0c7b2f66ee35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:00.193317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac6af9-7d41-4fd4-b73d-0c7b2f66ee35 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:00.202502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 671/1342] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:00.451412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc257-5e3e-4a98-af67-72b7fed73d7c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:00.451700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc257-5e3e-4a98-af67-72b7fed73d7c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:00.452009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc257-5e3e-4a98-af67-72b7fed73d7c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:00.454142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 672/1343] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:00.460289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf968ba-38ed-43cf-996d-6396fa3b923d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:00.460580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf968ba-38ed-43cf-996d-6396fa3b923d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:00.460853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf968ba-38ed-43cf-996d-6396fa3b923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:00.478424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2bf968ba-38ed-43cf-996d-6396fa3b923d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:00.479593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2bf968ba-38ed-43cf-996d-6396fa3b923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:00.494379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 672/1344] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:00.537906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc257-5e3e-4a98-af67-72b7fed73d7c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:00.552920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc257-5e3e-4a98-af67-72b7fed73d7c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:00.558468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d564-2aa8-4123-804e-936d166e3f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:00.559105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d564-2aa8-4123-804e-936d166e3f33 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:00.559394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d564-2aa8-4123-804e-936d166e3f33 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:00.559681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d564-2aa8-4123-804e-936d166e3f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:00.570111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1d564-2aa8-4123-804e-936d166e3f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:00.571740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1d564-2aa8-4123-804e-936d166e3f33 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:00.581419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 673/1345] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:00.867854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181494c5-ff91-42c7-a2d2-cc7cffa9d5c5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:00.868170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181494c5-ff91-42c7-a2d2-cc7cffa9d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:00.868448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181494c5-ff91-42c7-a2d2-cc7cffa9d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:00.923449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-181494c5-ff91-42c7-a2d2-cc7cffa9d5c5 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:00.924673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-181494c5-ff91-42c7-a2d2-cc7cffa9d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:00.993738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 673/1346] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:26:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:01.042498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea687062-305e-4131-91d2-5a366caa0d1b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:01.042965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea687062-305e-4131-91d2-5a366caa0d1b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:01.043084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea687062-305e-4131-91d2-5a366caa0d1b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:01.044939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 674/1347] 10.222.0.11 () {54 vars in 942 bytes} [Thu Nov 11 16:26:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:01.052823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6aba-e95a-4fe8-a9b2-b9792f1250ef None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:01.053181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6aba-e95a-4fe8-a9b2-b9792f1250ef None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:01.053558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6aba-e95a-4fe8-a9b2-b9792f1250ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:01.101842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ad0b6aba-e95a-4fe8-a9b2-b9792f1250ef None None] MFA Rules not processed for user `43db7d84ce72442cbccd9ee65c70551b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:01.103126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad0b6aba-e95a-4fe8-a9b2-b9792f1250ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:01.173977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 674/1348] 10.222.0.11 () {58 vars in 1039 bytes} [Thu Nov 11 16:26:01 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:01.183613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea687062-305e-4131-91d2-5a366caa0d1b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:01.197888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea687062-305e-4131-91d2-5a366caa0d1b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:01.202832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e1fd8-d5f5-4682-a509-12ce2a9bb137 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:01.203490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e1fd8-d5f5-4682-a509-12ce2a9bb137 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:01.203774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e1fd8-d5f5-4682-a509-12ce2a9bb137 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:01.204053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e1fd8-d5f5-4682-a509-12ce2a9bb137 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:01.211884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e1fd8-d5f5-4682-a509-12ce2a9bb137 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:01.213464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e1fd8-d5f5-4682-a509-12ce2a9bb137 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:01.221407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 675/1349] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:26:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:26:03.070367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dec78-8c3e-4b32-8762-a0c254f0f6b3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:03.070979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dec78-8c3e-4b32-8762-a0c254f0f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:03.070979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dec78-8c3e-4b32-8762-a0c254f0f6b3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:03.072714 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 675/1350] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:03.079112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63defd51-4988-4e85-bfa2-7f28cc99154c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:03.080012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63defd51-4988-4e85-bfa2-7f28cc99154c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:03.080550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63defd51-4988-4e85-bfa2-7f28cc99154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:03.105620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-63defd51-4988-4e85-bfa2-7f28cc99154c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:03.106845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-63defd51-4988-4e85-bfa2-7f28cc99154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:03.115171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 676/1351] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:03.164180 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dec78-8c3e-4b32-8762-a0c254f0f6b3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:03.179111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dec78-8c3e-4b32-8762-a0c254f0f6b3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:03.184525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccd935-a78f-4e32-801d-938fcb0d13fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:03.185148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd935-a78f-4e32-801d-938fcb0d13fa service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:03.185430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd935-a78f-4e32-801d-938fcb0d13fa service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:03.185705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd935-a78f-4e32-801d-938fcb0d13fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:03.194844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccd935-a78f-4e32-801d-938fcb0d13fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:03.196463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccd935-a78f-4e32-801d-938fcb0d13fa service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:03.207028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 676/1352] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:05.798547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79532bb-8dc9-44a3-abda-f10e0fc1ebce None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:05.799191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79532bb-8dc9-44a3-abda-f10e0fc1ebce None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:05.799191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79532bb-8dc9-44a3-abda-f10e0fc1ebce None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:05.800893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 677/1353] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:05.806799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbec70-1165-4887-8bfe-bdf9b91149f6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:05.807254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbec70-1165-4887-8bfe-bdf9b91149f6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:05.807500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbec70-1165-4887-8bfe-bdf9b91149f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:05.828243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f2fbec70-1165-4887-8bfe-bdf9b91149f6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:05.829523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f2fbec70-1165-4887-8bfe-bdf9b91149f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:05.838688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 677/1354] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:05.888969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79532bb-8dc9-44a3-abda-f10e0fc1ebce None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:05.903486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79532bb-8dc9-44a3-abda-f10e0fc1ebce None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:05.909960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd2370-d3c3-415b-acbb-839328ed1d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:05.912631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd2370-d3c3-415b-acbb-839328ed1d76 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:05.912935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd2370-d3c3-415b-acbb-839328ed1d76 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:05.913194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd2370-d3c3-415b-acbb-839328ed1d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:05.923137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd2370-d3c3-415b-acbb-839328ed1d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:05.924898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd2370-d3c3-415b-acbb-839328ed1d76 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:05.935178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 678/1355] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:20.379941 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff21c0-c8b3-481e-a6e8-675614e10c2b None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:20.380529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff21c0-c8b3-481e-a6e8-675614e10c2b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:20.380529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff21c0-c8b3-481e-a6e8-675614e10c2b None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:20.382308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 678/1356] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:20.388825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c27f8-04af-4fca-ad37-fea3405a5cfd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:20.389255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c27f8-04af-4fca-ad37-fea3405a5cfd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:20.389380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c27f8-04af-4fca-ad37-fea3405a5cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:20.407007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-797c27f8-04af-4fca-ad37-fea3405a5cfd None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:20.408169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-797c27f8-04af-4fca-ad37-fea3405a5cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:20.426875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 679/1357] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:26:20.453663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff21c0-c8b3-481e-a6e8-675614e10c2b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:20.465667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff21c0-c8b3-481e-a6e8-675614e10c2b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:20.470805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dbdbf-6f01-4de1-a737-c3bf9504aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:20.471439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dbdbf-6f01-4de1-a737-c3bf9504aa2e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:20.471715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dbdbf-6f01-4de1-a737-c3bf9504aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:20.471986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dbdbf-6f01-4de1-a737-c3bf9504aa2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:20.472730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dbdbf-6f01-4de1-a737-c3bf9504aa2e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:20.474602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dbdbf-6f01-4de1-a737-c3bf9504aa2e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:20.493432 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 679/1358] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:26:20 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:26:22.829618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c670-e05a-45ef-b3e7-6e2a5099fa29 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:22.830129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c670-e05a-45ef-b3e7-6e2a5099fa29 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:22.830129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c670-e05a-45ef-b3e7-6e2a5099fa29 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:22.831907 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 680/1359] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:22.837778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539358b6-7e4e-4cd9-9257-f54d976a0fc7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:22.838248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539358b6-7e4e-4cd9-9257-f54d976a0fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:22.838360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539358b6-7e4e-4cd9-9257-f54d976a0fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:22.857493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-539358b6-7e4e-4cd9-9257-f54d976a0fc7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:22.858715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-539358b6-7e4e-4cd9-9257-f54d976a0fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:22.866381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 680/1360] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:22.891526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c670-e05a-45ef-b3e7-6e2a5099fa29 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:22.904008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c670-e05a-45ef-b3e7-6e2a5099fa29 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:22.908381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:22.909204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:22.909484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:22.909756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] PATH_INFO: `/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:22.920551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=21cb8c562b7e4e5fb19de7911fc021bb)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:22.922710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:22.924379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 681/1361] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:26:22 2021] GET /identity/v3/projects/21cb8c562b7e4e5fb19de7911fc021bb => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:22.932286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539358b6-7e4e-4cd9-9257-f54d976a0fc7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:22.941369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539358b6-7e4e-4cd9-9257-f54d976a0fc7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:22.945857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ebf89-1bef-4e14-8848-fa69cf9498ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:22.946549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ebf89-1bef-4e14-8848-fa69cf9498ce admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:22.946833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ebf89-1bef-4e14-8848-fa69cf9498ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:22.947108 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ebf89-1bef-4e14-8848-fa69cf9498ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:22.947890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ebf89-1bef-4e14-8848-fa69cf9498ce admin admin] RBAC: Adding query filter params (scope.project.id=21cb8c562b7e4e5fb19de7911fc021bb) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:26:22.948195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ebf89-1bef-4e14-8848-fa69cf9498ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:22.950618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ebf89-1bef-4e14-8848-fa69cf9498ce admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:22.957254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 681/1362] 10.222.0.11 () {56 vars in 1231 bytes} [Thu Nov 11 16:26:22 2021] GET /identity/v3/role_assignments?scope.project.id=21cb8c562b7e4e5fb19de7911fc021bb => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:22.963379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:22.973598 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d58e0-6902-4574-8746-a67f11f3d3a4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:22.978278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360a0a4-1cc1-41ce-bc0a-efd82df1807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:22.979139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a0a4-1cc1-41ce-bc0a-efd82df1807c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:22.979419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a0a4-1cc1-41ce-bc0a-efd82df1807c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:22.979694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a0a4-1cc1-41ce-bc0a-efd82df1807c admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:22.992782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360a0a4-1cc1-41ce-bc0a-efd82df1807c admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:22.995021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360a0a4-1cc1-41ce-bc0a-efd82df1807c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:22.996645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 682/1363] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:22 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:25.308524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73296ad-730d-46f0-814c-70fe0b9c53fd None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:25.309077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73296ad-730d-46f0-814c-70fe0b9c53fd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:25.309195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73296ad-730d-46f0-814c-70fe0b9c53fd None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:25.310971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 682/1364] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:25.316896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d77fc-a877-4e0c-8e7e-52e226870eb5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:25.317318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d77fc-a877-4e0c-8e7e-52e226870eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:25.317506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d77fc-a877-4e0c-8e7e-52e226870eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:25.335391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8f1d77fc-a877-4e0c-8e7e-52e226870eb5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:25.336587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8f1d77fc-a877-4e0c-8e7e-52e226870eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:25.345191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 683/1365] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:25.369549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73296ad-730d-46f0-814c-70fe0b9c53fd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:25.382074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73296ad-730d-46f0-814c-70fe0b9c53fd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:25.386502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:25.387843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:25.388112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:25.388382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] PATH_INFO: `/v3/projects/2a0c29736da14389888d8615f26f6f27` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:25.399060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a0c29736da14389888d8615f26f6f27)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:25.401110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:25.402905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 683/1366] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:26:25 2021] GET /identity/v3/projects/2a0c29736da14389888d8615f26f6f27 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:25.411690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d77fc-a877-4e0c-8e7e-52e226870eb5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:25.420958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d77fc-a877-4e0c-8e7e-52e226870eb5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:25.425555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:25.426225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:25.426585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:25.426862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:25.427680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] RBAC: Adding query filter params (scope.project.id=2a0c29736da14389888d8615f26f6f27) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:26:25.427989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:25.429821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:25.438165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 684/1367] 10.222.0.11 () {56 vars in 1231 bytes} [Thu Nov 11 16:26:25 2021] GET /identity/v3/role_assignments?scope.project.id=2a0c29736da14389888d8615f26f6f27 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:26:25.444329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:25.454675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c05f9-862c-4cbc-8f65-ccdc392dfae3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:25.459230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930d911-8093-4952-ba6e-ff1ec8b396a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:25.460073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d911-8093-4952-ba6e-ff1ec8b396a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:25.460356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d911-8093-4952-ba6e-ff1ec8b396a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:25.460632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930d911-8093-4952-ba6e-ff1ec8b396a2 admin admin] PATH_INFO: `/v3/users/006e3536282045bd8a55063307aeb44d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:25.474062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930d911-8093-4952-ba6e-ff1ec8b396a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=006e3536282045bd8a55063307aeb44d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:25.476237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930d911-8093-4952-ba6e-ff1ec8b396a2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:25.477879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 684/1368] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:25 2021] GET /identity/v3/users/006e3536282045bd8a55063307aeb44d => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:25.484218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:25.493791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96b194-e717-4d19-bd32-53d17e0c5939 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:25.499071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4322a7-199d-4f6f-be01-2b1e878eed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:25.499912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4322a7-199d-4f6f-be01-2b1e878eed83 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:25.500196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4322a7-199d-4f6f-be01-2b1e878eed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:25.500474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4322a7-199d-4f6f-be01-2b1e878eed83 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:25.501662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4322a7-199d-4f6f-be01-2b1e878eed83 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:25.503466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4322a7-199d-4f6f-be01-2b1e878eed83 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:25.505024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 685/1369] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:25 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:27.894813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28089-770b-48ec-a4c7-0d67477d95bc None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:27.895317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28089-770b-48ec-a4c7-0d67477d95bc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:27.895421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28089-770b-48ec-a4c7-0d67477d95bc None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:27.897130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 685/1370] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:26:27.903996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be79ae-cdb5-4493-83be-479a0a464f8e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:27.904433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be79ae-cdb5-4493-83be-479a0a464f8e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:27.904528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be79ae-cdb5-4493-83be-479a0a464f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:27.923183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a5be79ae-cdb5-4493-83be-479a0a464f8e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:27.924425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a5be79ae-cdb5-4493-83be-479a0a464f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:27.932275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 686/1371] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:27.955954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f28089-770b-48ec-a4c7-0d67477d95bc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:27.968791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f28089-770b-48ec-a4c7-0d67477d95bc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:27.973197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:27.974022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:27.974349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:27.974628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] PATH_INFO: `/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:27.985737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] RBAC: Authorizing `identity:get_project(project_id=4d87ad2ecf9a4de28370ec953d3fab63)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:27.987915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:27.989592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 686/1372] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:26:27 2021] GET /identity/v3/projects/4d87ad2ecf9a4de28370ec953d3fab63 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:27.997526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be79ae-cdb5-4493-83be-479a0a464f8e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:28.006365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be79ae-cdb5-4493-83be-479a0a464f8e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:28.010920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:28.011550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:28.011831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:28.012690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:28.013673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] RBAC: Adding query filter params (scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:26:28.013980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:28.015865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:28.021574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 687/1373] 10.222.0.11 () {56 vars in 1231 bytes} [Thu Nov 11 16:26:27 2021] GET /identity/v3/role_assignments?scope.project.id=4d87ad2ecf9a4de28370ec953d3fab63 => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:28.027448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:28.037800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b9b8-7243-4aa0-af98-36dc02be71ad admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:28.042298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd72eba-dbcc-455a-8a58-a93aec45073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:28.043189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72eba-dbcc-455a-8a58-a93aec45073d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:28.043488 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72eba-dbcc-455a-8a58-a93aec45073d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:28.043771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72eba-dbcc-455a-8a58-a93aec45073d admin admin] PATH_INFO: `/v3/users/f90ba6d748104478b8a08f484ba3b3d4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:28.056648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd72eba-dbcc-455a-8a58-a93aec45073d admin admin] RBAC: Authorizing `identity:get_user(user_id=f90ba6d748104478b8a08f484ba3b3d4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:28.058908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd72eba-dbcc-455a-8a58-a93aec45073d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:28.060632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 687/1374] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:28 2021] GET /identity/v3/users/f90ba6d748104478b8a08f484ba3b3d4 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:28.066878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:28.077083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a3b2f-ca5b-407f-a0cf-e0dbad4115a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:28.081725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245fc1b-b900-46c2-9ec3-849ed50fff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:28.082612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fc1b-b900-46c2-9ec3-849ed50fff01 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:28.082900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fc1b-b900-46c2-9ec3-849ed50fff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:28.083180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fc1b-b900-46c2-9ec3-849ed50fff01 admin admin] PATH_INFO: `/v3/users/18ecbc0934b1435f8754a11e8343ad85` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:28.097817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245fc1b-b900-46c2-9ec3-849ed50fff01 admin admin] RBAC: Authorizing `identity:get_user(user_id=18ecbc0934b1435f8754a11e8343ad85)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:28.099981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245fc1b-b900-46c2-9ec3-849ed50fff01 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:28.101650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 688/1375] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:28 2021] GET /identity/v3/users/18ecbc0934b1435f8754a11e8343ad85 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:30.436645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5bad0-0876-4dfe-a61f-928446fdf2b3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:30.437184 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5bad0-0876-4dfe-a61f-928446fdf2b3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:30.437295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5bad0-0876-4dfe-a61f-928446fdf2b3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:30.439060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 688/1376] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:30.444918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ceff0-22a0-45af-be59-824e2b9046a9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:30.445395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ceff0-22a0-45af-be59-824e2b9046a9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:30.445501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ceff0-22a0-45af-be59-824e2b9046a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:30.463205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-272ceff0-22a0-45af-be59-824e2b9046a9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:30.464388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-272ceff0-22a0-45af-be59-824e2b9046a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:30.472510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 689/1377] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:30.497894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5bad0-0876-4dfe-a61f-928446fdf2b3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:30.509849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5bad0-0876-4dfe-a61f-928446fdf2b3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:30.514503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:30.515326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:30.515608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:30.515878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] PATH_INFO: `/v3/projects/549aab745e5b401181e0ecf7c85c05fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:30.526073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] RBAC: Authorizing `identity:get_project(project_id=549aab745e5b401181e0ecf7c85c05fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:30.528646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:30.530326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 689/1378] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:26:30 2021] GET /identity/v3/projects/549aab745e5b401181e0ecf7c85c05fe => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:30.538850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ceff0-22a0-45af-be59-824e2b9046a9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:30.549494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ceff0-22a0-45af-be59-824e2b9046a9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:30.553920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:30.554596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:30.554877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:30.555151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:30.555936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] RBAC: Adding query filter params (scope.project.id=549aab745e5b401181e0ecf7c85c05fe) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:26:30.556241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:30.558063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:30.565529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 690/1379] 10.222.0.11 () {56 vars in 1231 bytes} [Thu Nov 11 16:26:30 2021] GET /identity/v3/role_assignments?scope.project.id=549aab745e5b401181e0ecf7c85c05fe => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:26:30.571957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:30.581978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b55b-7fb1-4db2-9cc2-b9d11d2e5c30 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:30.586450 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e206-1ee0-4b48-aafa-e9b62d78e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:30.587300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e206-1ee0-4b48-aafa-e9b62d78e85c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:30.587578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e206-1ee0-4b48-aafa-e9b62d78e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:30.587850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e206-1ee0-4b48-aafa-e9b62d78e85c admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:30.589039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e206-1ee0-4b48-aafa-e9b62d78e85c admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:30.591483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e206-1ee0-4b48-aafa-e9b62d78e85c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:30.593055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 690/1380] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:30 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:30.599211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:30.609980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab61775-249d-41ef-bf67-37724d15eb6a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:30.614593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08652722-694a-4e58-9370-10a721615006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:30.615445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08652722-694a-4e58-9370-10a721615006 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:30.615731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08652722-694a-4e58-9370-10a721615006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:30.616013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08652722-694a-4e58-9370-10a721615006 admin admin] PATH_INFO: `/v3/users/3c084d344b7b4433be0a9b2c80d5f23c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:30.617215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08652722-694a-4e58-9370-10a721615006 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c084d344b7b4433be0a9b2c80d5f23c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:30.619353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08652722-694a-4e58-9370-10a721615006 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:30.620937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 691/1381] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:30 2021] GET /identity/v3/users/3c084d344b7b4433be0a9b2c80d5f23c => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:32.987258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29fd1-f426-4e6d-b94c-978caad92dcb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:32.987821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29fd1-f426-4e6d-b94c-978caad92dcb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:32.987821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29fd1-f426-4e6d-b94c-978caad92dcb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:32.989631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 691/1382] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:32.995571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66f449-9425-45e1-9a78-03f5bf239d12 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:32.996133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66f449-9425-45e1-9a78-03f5bf239d12 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:32.996133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66f449-9425-45e1-9a78-03f5bf239d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:33.013239 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2e66f449-9425-45e1-9a78-03f5bf239d12 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:33.014438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2e66f449-9425-45e1-9a78-03f5bf239d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:33.022618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 692/1383] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:33.047375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f29fd1-f426-4e6d-b94c-978caad92dcb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:33.059516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f29fd1-f426-4e6d-b94c-978caad92dcb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:33.063930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:33.064759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:33.065045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:33.065325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] PATH_INFO: `/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:33.076100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] RBAC: Authorizing `identity:get_project(project_id=8512c2c73155450bb57c7b9b5fe2b6c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:33.078223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:33.079912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 692/1384] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:26:33 2021] GET /identity/v3/projects/8512c2c73155450bb57c7b9b5fe2b6c8 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:33.087896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66f449-9425-45e1-9a78-03f5bf239d12 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:33.097788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66f449-9425-45e1-9a78-03f5bf239d12 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:33.102577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fdca2-17cf-4b49-a10d-86c69fff1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:33.103230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdca2-17cf-4b49-a10d-86c69fff1c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:33.103529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdca2-17cf-4b49-a10d-86c69fff1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:33.103798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdca2-17cf-4b49-a10d-86c69fff1c3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:33.104710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdca2-17cf-4b49-a10d-86c69fff1c3c admin admin] RBAC: Adding query filter params (scope.project.id=8512c2c73155450bb57c7b9b5fe2b6c8) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:26:33.105025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdca2-17cf-4b49-a10d-86c69fff1c3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:33.107660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdca2-17cf-4b49-a10d-86c69fff1c3c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:33.113080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 693/1385] 10.222.0.11 () {56 vars in 1231 bytes} [Thu Nov 11 16:26:33 2021] GET /identity/v3/role_assignments?scope.project.id=8512c2c73155450bb57c7b9b5fe2b6c8 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:33.119313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:33.128945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4cb8d-6f8c-42e2-8f5f-c65cdb18ac98 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:33.133588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560f49-2733-42a9-a64a-9519a15cdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:33.134467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560f49-2733-42a9-a64a-9519a15cdf54 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:33.134750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560f49-2733-42a9-a64a-9519a15cdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:33.135027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560f49-2733-42a9-a64a-9519a15cdf54 admin admin] PATH_INFO: `/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:33.149524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560f49-2733-42a9-a64a-9519a15cdf54 admin admin] RBAC: Authorizing `identity:get_user(user_id=fc7996bea5e8465d8cdc4af214e4c6b1)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:33.151700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560f49-2733-42a9-a64a-9519a15cdf54 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:33.154102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 693/1386] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:33 2021] GET /identity/v3/users/fc7996bea5e8465d8cdc4af214e4c6b1 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:35.523434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ccd90-3ccb-4a8e-b38e-d29f55560200 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:35.524035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ccd90-3ccb-4a8e-b38e-d29f55560200 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:35.524035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ccd90-3ccb-4a8e-b38e-d29f55560200 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:35.525767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 694/1387] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:35.533097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0633479-d091-44d3-bf8d-01a1552a4267 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:35.533575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0633479-d091-44d3-bf8d-01a1552a4267 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:35.533702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0633479-d091-44d3-bf8d-01a1552a4267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:35.557438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f0633479-d091-44d3-bf8d-01a1552a4267 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:35.558687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f0633479-d091-44d3-bf8d-01a1552a4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:35.566399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 694/1388] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:35.593093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ccd90-3ccb-4a8e-b38e-d29f55560200 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:35.610577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ccd90-3ccb-4a8e-b38e-d29f55560200 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:35.616134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:35.616979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:35.617264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:35.617543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] PATH_INFO: `/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:35.618781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] RBAC: Authorizing `identity:get_project(project_id=9e90b3c560e34b33b6dbbbe37d81f1b5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:35.620998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:35.622978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 695/1389] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:26:35 2021] GET /identity/v3/projects/9e90b3c560e34b33b6dbbbe37d81f1b5 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:26:35.631088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0633479-d091-44d3-bf8d-01a1552a4267 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:35.642343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0633479-d091-44d3-bf8d-01a1552a4267 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:35.646883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1f763-373b-4973-8dd5-1acedb775ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:35.647522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f763-373b-4973-8dd5-1acedb775ccf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:35.647808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f763-373b-4973-8dd5-1acedb775ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:35.648076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f763-373b-4973-8dd5-1acedb775ccf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:35.648862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1f763-373b-4973-8dd5-1acedb775ccf admin admin] RBAC: Adding query filter params (scope.project.id=9e90b3c560e34b33b6dbbbe37d81f1b5) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:26:35.649162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1f763-373b-4973-8dd5-1acedb775ccf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:35.651048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1f763-373b-4973-8dd5-1acedb775ccf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:35.661028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 695/1390] 10.222.0.11 () {56 vars in 1231 bytes} [Thu Nov 11 16:26:35 2021] GET /identity/v3/role_assignments?scope.project.id=9e90b3c560e34b33b6dbbbe37d81f1b5 => generated 879 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:35.667560 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:35.677693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2ee61-5888-4a46-99f6-df3e92b76e3a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:35.682437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dc589-7912-47af-a5a3-9c9a9e28e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:35.683337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc589-7912-47af-a5a3-9c9a9e28e392 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:35.683618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc589-7912-47af-a5a3-9c9a9e28e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:35.683897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dc589-7912-47af-a5a3-9c9a9e28e392 admin admin] PATH_INFO: `/v3/users/6fe756dac77c46179eda340982f2b52b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:35.685097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dc589-7912-47af-a5a3-9c9a9e28e392 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fe756dac77c46179eda340982f2b52b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:35.686913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dc589-7912-47af-a5a3-9c9a9e28e392 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:35.688502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 696/1391] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:35 2021] GET /identity/v3/users/6fe756dac77c46179eda340982f2b52b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:37.979121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b62a8-6113-4574-b523-7a77032d9ae8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:37.980528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b62a8-6113-4574-b523-7a77032d9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:37.980528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b62a8-6113-4574-b523-7a77032d9ae8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:37.981994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 696/1392] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:26:37.988385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8778-3f57-47e8-9e5c-11da93485612 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:37.989198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8778-3f57-47e8-9e5c-11da93485612 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:37.989475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8778-3f57-47e8-9e5c-11da93485612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:38.007744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ca0c8778-3f57-47e8-9e5c-11da93485612 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:38.009850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ca0c8778-3f57-47e8-9e5c-11da93485612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:38.017148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 697/1393] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:38.042800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b62a8-6113-4574-b523-7a77032d9ae8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:38.054954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b62a8-6113-4574-b523-7a77032d9ae8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:38.059927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:38.067262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:38.067262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:38.067262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] PATH_INFO: `/v3/projects/aca1441d94094af2944b11f01b77b6a4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:38.072201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] RBAC: Authorizing `identity:get_project(project_id=aca1441d94094af2944b11f01b77b6a4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:38.074525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:38.076295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 697/1394] 10.222.0.11 () {56 vars in 1207 bytes} [Thu Nov 11 16:26:38 2021] GET /identity/v3/projects/aca1441d94094af2944b11f01b77b6a4 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:38.084478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8778-3f57-47e8-9e5c-11da93485612 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:38.093614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8778-3f57-47e8-9e5c-11da93485612 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:38.098141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126ae64-2b0f-4bff-b283-358b7dcbbbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:38.098896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126ae64-2b0f-4bff-b283-358b7dcbbbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:38.099181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126ae64-2b0f-4bff-b283-358b7dcbbbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:38.099452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126ae64-2b0f-4bff-b283-358b7dcbbbc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:38.100233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126ae64-2b0f-4bff-b283-358b7dcbbbc8 admin admin] RBAC: Adding query filter params (scope.project.id=aca1441d94094af2944b11f01b77b6a4) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:26:38.100580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126ae64-2b0f-4bff-b283-358b7dcbbbc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:38.102474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126ae64-2b0f-4bff-b283-358b7dcbbbc8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:38.108593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 698/1395] 10.222.0.11 () {56 vars in 1231 bytes} [Thu Nov 11 16:26:38 2021] GET /identity/v3/role_assignments?scope.project.id=aca1441d94094af2944b11f01b77b6a4 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:38.115181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:38.125557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10647e-386c-4925-9fb7-26a68c614dbc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:38.130072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07616a-4fc6-4d66-9830-e1a8ecfe2155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:38.130960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07616a-4fc6-4d66-9830-e1a8ecfe2155 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:38.131242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07616a-4fc6-4d66-9830-e1a8ecfe2155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:38.131520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07616a-4fc6-4d66-9830-e1a8ecfe2155 admin admin] PATH_INFO: `/v3/users/400a0a3eb518433b95031e9677a1d159` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:38.144700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07616a-4fc6-4d66-9830-e1a8ecfe2155 admin admin] RBAC: Authorizing `identity:get_user(user_id=400a0a3eb518433b95031e9677a1d159)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:38.146870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07616a-4fc6-4d66-9830-e1a8ecfe2155 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:38.148502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 698/1396] 10.222.0.11 () {56 vars in 1198 bytes} [Thu Nov 11 16:26:38 2021] GET /identity/v3/users/400a0a3eb518433b95031e9677a1d159 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:26:43.265243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f0f9-52f4-4d33-9959-d76f35b85190 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:43.265840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f0f9-52f4-4d33-9959-d76f35b85190 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:43.265960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f0f9-52f4-4d33-9959-d76f35b85190 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:43.267699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 699/1397] 10.222.0.11 () {54 vars in 918 bytes} [Thu Nov 11 16:26:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:43.273481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240de24-77be-45f5-afc1-cbf2a1342737 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:43.273919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240de24-77be-45f5-afc1-cbf2a1342737 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:43.274023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240de24-77be-45f5-afc1-cbf2a1342737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:43.292027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9240de24-77be-45f5-afc1-cbf2a1342737 None None] MFA Rules not processed for user `c8a0c26778994b0c93541400cde47bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:43.293209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9240de24-77be-45f5-afc1-cbf2a1342737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:43.301460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 699/1398] 10.222.0.11 () {58 vars in 1015 bytes} [Thu Nov 11 16:26:43 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:43.316432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09c2e-df1e-497b-8172-edb80087f419 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:43.316715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09c2e-df1e-497b-8172-edb80087f419 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:43.316989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09c2e-df1e-497b-8172-edb80087f419 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:43.318774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 700/1399] 10.222.0.11 () {54 vars in 918 bytes} [Thu Nov 11 16:26:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:43.324572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848fe35-b979-4846-a356-1c68f3330c38 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:43.324861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848fe35-b979-4846-a356-1c68f3330c38 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:43.325144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848fe35-b979-4846-a356-1c68f3330c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:43.343302 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b848fe35-b979-4846-a356-1c68f3330c38 None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:43.344481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b848fe35-b979-4846-a356-1c68f3330c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:43.353445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 700/1400] 10.222.0.11 () {58 vars in 1015 bytes} [Thu Nov 11 16:26:43 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:46.145931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089936-1653-49db-82e3-8e8896053e57 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:46.146558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089936-1653-49db-82e3-8e8896053e57 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:46.146558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089936-1653-49db-82e3-8e8896053e57 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:46.148215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 701/1401] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:26:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:46.154064 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1f584-d0e4-45e7-8554-845d6eb8b833 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:46.154537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1f584-d0e4-45e7-8554-845d6eb8b833 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:46.154682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1f584-d0e4-45e7-8554-845d6eb8b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:46.173245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d9c1f584-d0e4-45e7-8554-845d6eb8b833 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:46.174481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d9c1f584-d0e4-45e7-8554-845d6eb8b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:46.182188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 701/1402] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:26:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:46.227016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089936-1653-49db-82e3-8e8896053e57 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:46.241800 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089936-1653-49db-82e3-8e8896053e57 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:46.248288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74887ee2-9af7-4efb-bdfd-68e8270f1342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:46.248924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74887ee2-9af7-4efb-bdfd-68e8270f1342 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:46.249204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74887ee2-9af7-4efb-bdfd-68e8270f1342 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:46.249479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74887ee2-9af7-4efb-bdfd-68e8270f1342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:46.257278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74887ee2-9af7-4efb-bdfd-68e8270f1342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:46.258883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74887ee2-9af7-4efb-bdfd-68e8270f1342 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:46.268346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 702/1403] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:47.766127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6137f6-c9f4-48b2-8512-040a6596c41b None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:47.766710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6137f6-c9f4-48b2-8512-040a6596c41b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:47.766816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6137f6-c9f4-48b2-8512-040a6596c41b None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:47.768556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 702/1404] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:47.774292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95a9d-92d2-418f-bf83-bb8c537df659 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:47.774706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95a9d-92d2-418f-bf83-bb8c537df659 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:47.774860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95a9d-92d2-418f-bf83-bb8c537df659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:47.794928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bdf95a9d-92d2-418f-bf83-bb8c537df659 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:47.794928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bdf95a9d-92d2-418f-bf83-bb8c537df659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:47.802107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 703/1405] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:47.955798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6137f6-c9f4-48b2-8512-040a6596c41b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:47.969871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6137f6-c9f4-48b2-8512-040a6596c41b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:47.975239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d39c6-3015-4721-8c7f-94e03261ea16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:47.975862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d39c6-3015-4721-8c7f-94e03261ea16 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:47.976145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d39c6-3015-4721-8c7f-94e03261ea16 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:47.976419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d39c6-3015-4721-8c7f-94e03261ea16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:47.984353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d39c6-3015-4721-8c7f-94e03261ea16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:47.985921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d39c6-3015-4721-8c7f-94e03261ea16 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:47.995730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 703/1406] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:49.457161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237bb24-f701-47c5-9703-3032a91aa5a1 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:49.457781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237bb24-f701-47c5-9703-3032a91aa5a1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:49.457781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237bb24-f701-47c5-9703-3032a91aa5a1 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:49.459644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 704/1407] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:49.465066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34538-9f39-43f9-bbbb-a34d95e85308 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:49.465600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34538-9f39-43f9-bbbb-a34d95e85308 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:49.465600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f34538-9f39-43f9-bbbb-a34d95e85308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:49.482910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e1f34538-9f39-43f9-bbbb-a34d95e85308 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:49.484130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e1f34538-9f39-43f9-bbbb-a34d95e85308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:49.491803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 704/1408] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:49.642483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237bb24-f701-47c5-9703-3032a91aa5a1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:49.656455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237bb24-f701-47c5-9703-3032a91aa5a1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:49.662088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8af0f7-b1e0-4658-b415-eb845cd27db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:49.662745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af0f7-b1e0-4658-b415-eb845cd27db3 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:49.668026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af0f7-b1e0-4658-b415-eb845cd27db3 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:49.668026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8af0f7-b1e0-4658-b415-eb845cd27db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:49.671591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8af0f7-b1e0-4658-b415-eb845cd27db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:49.673173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8af0f7-b1e0-4658-b415-eb845cd27db3 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:49.683126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 705/1409] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:51.147495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d170bf3-c65f-4015-81d2-542fd9e1115d None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:51.148067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d170bf3-c65f-4015-81d2-542fd9e1115d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:51.148067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d170bf3-c65f-4015-81d2-542fd9e1115d None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:51.149827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 705/1410] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:51.155462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb2d9-7572-4906-af60-c0cddd6bc62a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:51.155884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb2d9-7572-4906-af60-c0cddd6bc62a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:51.156061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb2d9-7572-4906-af60-c0cddd6bc62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:51.174356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6cdeb2d9-7572-4906-af60-c0cddd6bc62a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:51.175660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6cdeb2d9-7572-4906-af60-c0cddd6bc62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:51.183902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 706/1411] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:51.341114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d170bf3-c65f-4015-81d2-542fd9e1115d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:51.355621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d170bf3-c65f-4015-81d2-542fd9e1115d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:51.360902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26268049-a6f6-458e-944e-801c134913ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:51.361521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26268049-a6f6-458e-944e-801c134913ae service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:51.361800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26268049-a6f6-458e-944e-801c134913ae service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:51.362070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26268049-a6f6-458e-944e-801c134913ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:51.370555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26268049-a6f6-458e-944e-801c134913ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:51.372095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26268049-a6f6-458e-944e-801c134913ae service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:51.381065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 706/1412] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:52.829389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e5db-6f1f-4963-9e21-b95b93d88670 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:52.829926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e5db-6f1f-4963-9e21-b95b93d88670 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:52.829926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e5db-6f1f-4963-9e21-b95b93d88670 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:52.831681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 707/1413] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:52.837218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea55f-f7e4-4938-948b-1beec4bf6a2f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:52.837646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea55f-f7e4-4938-948b-1beec4bf6a2f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:52.837745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea55f-f7e4-4938-948b-1beec4bf6a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:52.855857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b0dea55f-f7e4-4938-948b-1beec4bf6a2f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:52.857050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b0dea55f-f7e4-4938-948b-1beec4bf6a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:52.864761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 707/1414] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:53.016206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6e5db-6f1f-4963-9e21-b95b93d88670 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:53.030294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6e5db-6f1f-4963-9e21-b95b93d88670 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:53.035946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e153d00-11aa-489b-8960-1d9b9761d9f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:53.036581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e153d00-11aa-489b-8960-1d9b9761d9f2 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:53.036869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e153d00-11aa-489b-8960-1d9b9761d9f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:53.037148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e153d00-11aa-489b-8960-1d9b9761d9f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:53.045665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e153d00-11aa-489b-8960-1d9b9761d9f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:53.047318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e153d00-11aa-489b-8960-1d9b9761d9f2 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:53.056459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 708/1415] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:54.504818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c424-e473-44ee-b7fd-6e6cb1a9be55 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:54.505382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c424-e473-44ee-b7fd-6e6cb1a9be55 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:54.505382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c424-e473-44ee-b7fd-6e6cb1a9be55 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:54.507195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 708/1416] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:54.512825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f31e1-7679-45c7-93cd-486afeb0473b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:54.513217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f31e1-7679-45c7-93cd-486afeb0473b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:54.513410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f31e1-7679-45c7-93cd-486afeb0473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:54.531283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9c3f31e1-7679-45c7-93cd-486afeb0473b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:54.532497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9c3f31e1-7679-45c7-93cd-486afeb0473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:54.540836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 709/1417] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:54.696632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37c424-e473-44ee-b7fd-6e6cb1a9be55 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:54.710676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37c424-e473-44ee-b7fd-6e6cb1a9be55 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:54.716402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1139f-513e-4db0-b724-847294d83af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:54.717024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1139f-513e-4db0-b724-847294d83af4 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:54.717302 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1139f-513e-4db0-b724-847294d83af4 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:54.717580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1139f-513e-4db0-b724-847294d83af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:54.725459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1139f-513e-4db0-b724-847294d83af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:54.727060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1139f-513e-4db0-b724-847294d83af4 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:54.736864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 709/1418] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:56.204853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f0c1d-be1e-4f52-bb24-01aed63a1dab None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:56.205373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f0c1d-be1e-4f52-bb24-01aed63a1dab None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:56.205465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f0c1d-be1e-4f52-bb24-01aed63a1dab None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:56.207234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 710/1419] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:56.213350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24feed-5e19-42bf-bf58-67d3d0151f87 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:56.213835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24feed-5e19-42bf-bf58-67d3d0151f87 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:56.213945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24feed-5e19-42bf-bf58-67d3d0151f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:56.231746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1b24feed-5e19-42bf-bf58-67d3d0151f87 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:56.232913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1b24feed-5e19-42bf-bf58-67d3d0151f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:56.240502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 710/1420] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:56.393107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f0c1d-be1e-4f52-bb24-01aed63a1dab None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:56.407774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f0c1d-be1e-4f52-bb24-01aed63a1dab None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:56.413463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b18ec4-7a68-4a47-969a-db165824044e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:56.414091 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b18ec4-7a68-4a47-969a-db165824044e service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:56.414398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b18ec4-7a68-4a47-969a-db165824044e service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:56.414673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b18ec4-7a68-4a47-969a-db165824044e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:56.423382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b18ec4-7a68-4a47-969a-db165824044e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:56.424954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b18ec4-7a68-4a47-969a-db165824044e service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:56.434363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 711/1421] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:57.894903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d827be-13f8-45e6-9fd4-838cbd384b9c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:57.895359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d827be-13f8-45e6-9fd4-838cbd384b9c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:57.895453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d827be-13f8-45e6-9fd4-838cbd384b9c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:57.897216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 711/1422] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:57.903211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65172f9-3341-4795-8df1-f989a2c8dbb3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:57.903622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65172f9-3341-4795-8df1-f989a2c8dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:57.903778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65172f9-3341-4795-8df1-f989a2c8dbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:57.922315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c65172f9-3341-4795-8df1-f989a2c8dbb3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:57.923512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c65172f9-3341-4795-8df1-f989a2c8dbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:57.931189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 712/1423] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:58.085480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d827be-13f8-45e6-9fd4-838cbd384b9c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:58.099966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d827be-13f8-45e6-9fd4-838cbd384b9c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:58.105754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844d5dc-37c4-47b0-b209-9e19e0784468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:58.106425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d5dc-37c4-47b0-b209-9e19e0784468 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:58.106745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d5dc-37c4-47b0-b209-9e19e0784468 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:58.107062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d5dc-37c4-47b0-b209-9e19e0784468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:58.115420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844d5dc-37c4-47b0-b209-9e19e0784468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:58.117016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844d5dc-37c4-47b0-b209-9e19e0784468 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:58.126280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 712/1424] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:26:59.638045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b22ab-2f9b-4991-85e0-c1a17f8b0c97 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:59.638602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b22ab-2f9b-4991-85e0-c1a17f8b0c97 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:59.638691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b22ab-2f9b-4991-85e0-c1a17f8b0c97 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:59.640495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 713/1425] 10.222.0.11 () {54 vars in 911 bytes} [Thu Nov 11 16:26:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:26:59.645927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255cef-949d-48e6-8bed-92b36cb5690c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:59.646400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255cef-949d-48e6-8bed-92b36cb5690c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:59.646497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255cef-949d-48e6-8bed-92b36cb5690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:59.664643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4a255cef-949d-48e6-8bed-92b36cb5690c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:26:59.666195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4a255cef-949d-48e6-8bed-92b36cb5690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:26:59.673782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 713/1426] 10.222.0.11 () {58 vars in 1008 bytes} [Thu Nov 11 16:26:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:26:59.828366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b22ab-2f9b-4991-85e0-c1a17f8b0c97 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:26:59.843199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b22ab-2f9b-4991-85e0-c1a17f8b0c97 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:26:59.848558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e3b4a-9d06-4bca-acc5-e760b719c9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:26:59.849189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3b4a-9d06-4bca-acc5-e760b719c9e0 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:26:59.849474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3b4a-9d06-4bca-acc5-e760b719c9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:26:59.849752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3b4a-9d06-4bca-acc5-e760b719c9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:26:59.857758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3b4a-9d06-4bca-acc5-e760b719c9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:26:59.859443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3b4a-9d06-4bca-acc5-e760b719c9e0 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:26:59.869193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 714/1427] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:26:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:02.033489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059659-6fcf-46cc-87fd-059bddaa117b None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:02.034018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059659-6fcf-46cc-87fd-059bddaa117b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:02.034113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059659-6fcf-46cc-87fd-059bddaa117b None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:02.035869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 714/1428] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:02.042581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47157b6-d5b1-4c3a-9d6b-303ccafebcdd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:02.043021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47157b6-d5b1-4c3a-9d6b-303ccafebcdd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:02.043149 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47157b6-d5b1-4c3a-9d6b-303ccafebcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:02.061353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b47157b6-d5b1-4c3a-9d6b-303ccafebcdd None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:02.062588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b47157b6-d5b1-4c3a-9d6b-303ccafebcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:02.070164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 715/1429] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:27:02.110731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70059659-6fcf-46cc-87fd-059bddaa117b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:02.122196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70059659-6fcf-46cc-87fd-059bddaa117b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:02.125650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2942-1304-4f65-ab5d-8731dfaf461f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:02.126315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2942-1304-4f65-ab5d-8731dfaf461f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:02.126597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2942-1304-4f65-ab5d-8731dfaf461f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:02.126871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2942-1304-4f65-ab5d-8731dfaf461f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:02.136031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f2942-1304-4f65-ab5d-8731dfaf461f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:02.137393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f2942-1304-4f65-ab5d-8731dfaf461f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:02.146731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 715/1430] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:04.553806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae92294-c977-4507-a80b-db4bf0e2a6ce None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:04.554338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae92294-c977-4507-a80b-db4bf0e2a6ce None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:04.554436 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae92294-c977-4507-a80b-db4bf0e2a6ce None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:04.556891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 716/1431] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:04.562942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4143159-9792-488a-a7f9-24a6943dbacb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:04.563330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4143159-9792-488a-a7f9-24a6943dbacb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:04.563536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4143159-9792-488a-a7f9-24a6943dbacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:04.581920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d4143159-9792-488a-a7f9-24a6943dbacb None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:04.583152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d4143159-9792-488a-a7f9-24a6943dbacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:04.590925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 716/1432] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:04.631991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae92294-c977-4507-a80b-db4bf0e2a6ce None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:04.633645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0ae92294-c977-4507-a80b-db4bf0e2a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:04.646825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae92294-c977-4507-a80b-db4bf0e2a6ce None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:04.650343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a408135-60ad-40d9-a7a2-169ae4c2370a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:04.650973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a408135-60ad-40d9-a7a2-169ae4c2370a service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:04.651263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a408135-60ad-40d9-a7a2-169ae4c2370a service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:04.651540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a408135-60ad-40d9-a7a2-169ae4c2370a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:04.660387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a408135-60ad-40d9-a7a2-169ae4c2370a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:04.666737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a408135-60ad-40d9-a7a2-169ae4c2370a service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:04.671484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 717/1433] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:07.356964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745e8f-0c7e-41f3-8bb4-7e0bcae4de62 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:07.357527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745e8f-0c7e-41f3-8bb4-7e0bcae4de62 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:07.357527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745e8f-0c7e-41f3-8bb4-7e0bcae4de62 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:07.359316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 717/1434] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:07.365312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93390b-aeed-44c1-bed1-f447f60b054f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:07.365703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93390b-aeed-44c1-bed1-f447f60b054f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:07.365936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93390b-aeed-44c1-bed1-f447f60b054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:07.384173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5d93390b-aeed-44c1-bed1-f447f60b054f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:07.385394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5d93390b-aeed-44c1-bed1-f447f60b054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:07.392976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 718/1435] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:07.435333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745e8f-0c7e-41f3-8bb4-7e0bcae4de62 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:07.445959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745e8f-0c7e-41f3-8bb4-7e0bcae4de62 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:07.449493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46616162-b8c1-41b7-b1c8-0d2345503db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:07.450117 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46616162-b8c1-41b7-b1c8-0d2345503db8 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:07.450430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46616162-b8c1-41b7-b1c8-0d2345503db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:07.450703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46616162-b8c1-41b7-b1c8-0d2345503db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:07.460177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46616162-b8c1-41b7-b1c8-0d2345503db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:07.462258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46616162-b8c1-41b7-b1c8-0d2345503db8 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:07.471393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 718/1436] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:09.869172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39f1a-3c4e-4591-b426-9e5bccddec02 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:09.869709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39f1a-3c4e-4591-b426-9e5bccddec02 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:09.869709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39f1a-3c4e-4591-b426-9e5bccddec02 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:09.871527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 719/1437] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:09.877369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551abd-2dd2-4709-b0f4-ba08443036e0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:09.877777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551abd-2dd2-4709-b0f4-ba08443036e0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:09.877924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551abd-2dd2-4709-b0f4-ba08443036e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:09.895263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-99551abd-2dd2-4709-b0f4-ba08443036e0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:09.896431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-99551abd-2dd2-4709-b0f4-ba08443036e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:09.904818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 719/1438] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:09.946526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c39f1a-3c4e-4591-b426-9e5bccddec02 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:09.956957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c39f1a-3c4e-4591-b426-9e5bccddec02 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:09.960449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e8c2-cc7c-4fd8-8888-5f0b90f36510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:09.961080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e8c2-cc7c-4fd8-8888-5f0b90f36510 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:09.961366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e8c2-cc7c-4fd8-8888-5f0b90f36510 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:09.962398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e8c2-cc7c-4fd8-8888-5f0b90f36510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:09.971472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109e8c2-cc7c-4fd8-8888-5f0b90f36510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:09.972898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109e8c2-cc7c-4fd8-8888-5f0b90f36510 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:09.982582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 720/1439] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:12.395291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8d73-7ea7-4845-8973-aa8037ec03bf None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:12.395867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8d73-7ea7-4845-8973-aa8037ec03bf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:12.395867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb8d73-7ea7-4845-8973-aa8037ec03bf None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:12.397675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 720/1440] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:12.404182 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54276b-04ec-4284-8363-d99fa3061e82 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:12.404650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54276b-04ec-4284-8363-d99fa3061e82 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:12.404807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54276b-04ec-4284-8363-d99fa3061e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:12.422712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-dc54276b-04ec-4284-8363-d99fa3061e82 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:12.423902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dc54276b-04ec-4284-8363-d99fa3061e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:12.432013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 721/1441] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:12.474433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8d73-7ea7-4845-8973-aa8037ec03bf None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:12.485097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb8d73-7ea7-4845-8973-aa8037ec03bf None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:12.488661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a43e-052d-497d-847a-673eda7b4b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:12.489286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a43e-052d-497d-847a-673eda7b4b7c service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:12.489572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a43e-052d-497d-847a-673eda7b4b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:12.489845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a43e-052d-497d-847a-673eda7b4b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:12.498776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a43e-052d-497d-847a-673eda7b4b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:12.500220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a43e-052d-497d-847a-673eda7b4b7c service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:12.509906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 721/1442] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:14.858212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45992a-cf7e-4341-a731-c7fa1fc0a2b8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:14.858828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45992a-cf7e-4341-a731-c7fa1fc0a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:14.858828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45992a-cf7e-4341-a731-c7fa1fc0a2b8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:14.860489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 722/1443] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:14.866349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89eef9-6104-4c7c-8507-68cde6a216c8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:14.866776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89eef9-6104-4c7c-8507-68cde6a216c8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:14.866912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89eef9-6104-4c7c-8507-68cde6a216c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:14.884986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4d89eef9-6104-4c7c-8507-68cde6a216c8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:14.886167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4d89eef9-6104-4c7c-8507-68cde6a216c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:14.893863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 722/1444] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:14.935139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45992a-cf7e-4341-a731-c7fa1fc0a2b8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:14.946135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45992a-cf7e-4341-a731-c7fa1fc0a2b8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:14.949726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ddfb-62c9-4ba1-82f6-b565837dab85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:14.950390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ddfb-62c9-4ba1-82f6-b565837dab85 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:14.950671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ddfb-62c9-4ba1-82f6-b565837dab85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:14.950947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ddfb-62c9-4ba1-82f6-b565837dab85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:14.959646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ddfb-62c9-4ba1-82f6-b565837dab85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:14.962114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ddfb-62c9-4ba1-82f6-b565837dab85 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:14.971409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 723/1445] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:17.342282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f8d4-962c-4515-8337-a62349c6b95f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:17.342859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f8d4-962c-4515-8337-a62349c6b95f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:17.342859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f8d4-962c-4515-8337-a62349c6b95f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:17.344611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 723/1446] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:17.350590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02935142-a1f1-4255-8f6e-0ddc47b401ef None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:17.351001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02935142-a1f1-4255-8f6e-0ddc47b401ef None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:17.351157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02935142-a1f1-4255-8f6e-0ddc47b401ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:17.369628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-02935142-a1f1-4255-8f6e-0ddc47b401ef None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:17.370879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-02935142-a1f1-4255-8f6e-0ddc47b401ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:17.378694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 724/1447] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:17.419611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f8d4-962c-4515-8337-a62349c6b95f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:17.430695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f8d4-962c-4515-8337-a62349c6b95f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:17.434209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0080558-7064-44d9-9520-468c31e66f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:17.434846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0080558-7064-44d9-9520-468c31e66f8f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:17.435129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0080558-7064-44d9-9520-468c31e66f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:17.435407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0080558-7064-44d9-9520-468c31e66f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:17.444101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0080558-7064-44d9-9520-468c31e66f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:17.446301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0080558-7064-44d9-9520-468c31e66f8f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:17.455440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 724/1448] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:19.769276 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c490-4a06-4cea-864b-cdc87d300979 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:19.769832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c490-4a06-4cea-864b-cdc87d300979 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:19.769832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c490-4a06-4cea-864b-cdc87d300979 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:19.771654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 725/1449] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:19.778116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7977e-55c7-425a-b67b-db9a5afeb63a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:19.778576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7977e-55c7-425a-b67b-db9a5afeb63a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:19.778723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7977e-55c7-425a-b67b-db9a5afeb63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:19.797597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d5c7977e-55c7-425a-b67b-db9a5afeb63a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:19.798764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d5c7977e-55c7-425a-b67b-db9a5afeb63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:19.807137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 725/1450] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:19.847144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c490-4a06-4cea-864b-cdc87d300979 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:19.858254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c490-4a06-4cea-864b-cdc87d300979 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:19.861697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cbf46-1f2d-407f-bf04-915f8a34fd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:19.862376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cbf46-1f2d-407f-bf04-915f8a34fd45 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:19.862662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cbf46-1f2d-407f-bf04-915f8a34fd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:19.862935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cbf46-1f2d-407f-bf04-915f8a34fd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:19.872550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cbf46-1f2d-407f-bf04-915f8a34fd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:19.874018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cbf46-1f2d-407f-bf04-915f8a34fd45 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:19.883316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 726/1451] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:22.199387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dabfd-ba2a-4113-9628-476eb1f2a93c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:22.199933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dabfd-ba2a-4113-9628-476eb1f2a93c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:22.199933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dabfd-ba2a-4113-9628-476eb1f2a93c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:22.201722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 726/1452] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:22.207624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d0868-efad-406c-8b5f-7030a82b3fdd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:22.208028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d0868-efad-406c-8b5f-7030a82b3fdd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:22.208194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d0868-efad-406c-8b5f-7030a82b3fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:22.228031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-341d0868-efad-406c-8b5f-7030a82b3fdd None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:22.229218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-341d0868-efad-406c-8b5f-7030a82b3fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:22.236826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 727/1453] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:22.277026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dabfd-ba2a-4113-9628-476eb1f2a93c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:22.287822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dabfd-ba2a-4113-9628-476eb1f2a93c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:22.291644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d95c63-37b8-447d-8219-4b8c4740741f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:22.292265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95c63-37b8-447d-8219-4b8c4740741f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:22.292549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95c63-37b8-447d-8219-4b8c4740741f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:22.292828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d95c63-37b8-447d-8219-4b8c4740741f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:22.301596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d95c63-37b8-447d-8219-4b8c4740741f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:22.303114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d95c63-37b8-447d-8219-4b8c4740741f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:22.312573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 727/1454] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:24.584320 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df566a4-619e-4cef-8488-fed816d8bcdf None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:24.584866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df566a4-619e-4cef-8488-fed816d8bcdf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:24.584866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df566a4-619e-4cef-8488-fed816d8bcdf None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:24.587552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 728/1455] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:24.593404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498538-9597-441b-a9d7-876721fb5c7a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:24.593831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498538-9597-441b-a9d7-876721fb5c7a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:24.593956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498538-9597-441b-a9d7-876721fb5c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:24.611044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7a498538-9597-441b-a9d7-876721fb5c7a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:24.612217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7a498538-9597-441b-a9d7-876721fb5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:24.620270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 728/1456] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:27:24.659789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df566a4-619e-4cef-8488-fed816d8bcdf None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:24.670581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df566a4-619e-4cef-8488-fed816d8bcdf None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:24.674068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71d779-3026-4840-9c13-8d5da2c44daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:24.674727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d779-3026-4840-9c13-8d5da2c44daa service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:24.675013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d779-3026-4840-9c13-8d5da2c44daa service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:24.675292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d779-3026-4840-9c13-8d5da2c44daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:24.684372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71d779-3026-4840-9c13-8d5da2c44daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:24.685798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71d779-3026-4840-9c13-8d5da2c44daa service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:24.695463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 729/1457] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:47.459970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27bd0-1178-45d1-8880-e297768c745a None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:47.460578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27bd0-1178-45d1-8880-e297768c745a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:47.460578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27bd0-1178-45d1-8880-e297768c745a None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:47.462356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 729/1458] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:47.469975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04f7c-49d5-4390-ae26-b4198d5c9959 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:47.470446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04f7c-49d5-4390-ae26-b4198d5c9959 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:47.470581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04f7c-49d5-4390-ae26-b4198d5c9959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:47.489291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-14e04f7c-49d5-4390-ae26-b4198d5c9959 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:47.490958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-14e04f7c-49d5-4390-ae26-b4198d5c9959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:47.498897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 730/1459] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:47.550150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83798f-d093-4af5-8b3c-e32f80651f7c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:47.550482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83798f-d093-4af5-8b3c-e32f80651f7c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:47.550809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83798f-d093-4af5-8b3c-e32f80651f7c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:47.552700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 730/1460] 10.222.0.11 () {54 vars in 962 bytes} [Thu Nov 11 16:27:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:47.557961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220a883-623e-4196-a11c-ba7a78ab1da5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:47.558274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220a883-623e-4196-a11c-ba7a78ab1da5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:47.558559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220a883-623e-4196-a11c-ba7a78ab1da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:47.576716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8220a883-623e-4196-a11c-ba7a78ab1da5 None None] MFA Rules not processed for user `0d63f82b065248d68fe044e9de8b7b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:47.577900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8220a883-623e-4196-a11c-ba7a78ab1da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:47.585055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 731/1461] 10.222.0.11 () {58 vars in 1059 bytes} [Thu Nov 11 16:27:47 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:47.592726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83798f-d093-4af5-8b3c-e32f80651f7c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:47.603211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83798f-d093-4af5-8b3c-e32f80651f7c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:47.606751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627df81-fb19-46fe-933e-7b25526d11ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:47.607370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627df81-fb19-46fe-933e-7b25526d11ad service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:47.607654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627df81-fb19-46fe-933e-7b25526d11ad service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:47.607931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627df81-fb19-46fe-933e-7b25526d11ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:47.616611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627df81-fb19-46fe-933e-7b25526d11ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:47.618036 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627df81-fb19-46fe-933e-7b25526d11ad service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:47.627238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 731/1462] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:50.038134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae0ecd-58b7-4a43-b8d8-c3297bffb218 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:50.038715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae0ecd-58b7-4a43-b8d8-c3297bffb218 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:50.038715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae0ecd-58b7-4a43-b8d8-c3297bffb218 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:50.040490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 732/1463] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:50.046518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf27e8-9f93-48a9-bd0b-59ad2131165a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:50.047057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf27e8-9f93-48a9-bd0b-59ad2131165a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:50.047057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf27e8-9f93-48a9-bd0b-59ad2131165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:50.064551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d2bf27e8-9f93-48a9-bd0b-59ad2131165a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:50.065727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d2bf27e8-9f93-48a9-bd0b-59ad2131165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:50.074027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 732/1464] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:50.100844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae0ecd-58b7-4a43-b8d8-c3297bffb218 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:50.112870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae0ecd-58b7-4a43-b8d8-c3297bffb218 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:50.118358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579a217-f69c-4c74-96a0-784414789dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:50.119002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a217-f69c-4c74-96a0-784414789dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:50.119284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a217-f69c-4c74-96a0-784414789dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:50.119561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579a217-f69c-4c74-96a0-784414789dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:50.120316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579a217-f69c-4c74-96a0-784414789dbc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:50.122147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579a217-f69c-4c74-96a0-784414789dbc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:50.136398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 733/1465] 10.222.0.11 () {56 vars in 1108 bytes} [Thu Nov 11 16:27:50 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:27:52.434040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a5ab0-5fa9-4aea-bd88-2d38232c6709 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:52.434636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a5ab0-5fa9-4aea-bd88-2d38232c6709 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:52.434636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a5ab0-5fa9-4aea-bd88-2d38232c6709 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:52.436417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 733/1466] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:52.443180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893565b-99f6-4083-bee7-4422d2f74cc8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:52.443619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893565b-99f6-4083-bee7-4422d2f74cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:52.443905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893565b-99f6-4083-bee7-4422d2f74cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:52.461962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1893565b-99f6-4083-bee7-4422d2f74cc8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:52.463184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1893565b-99f6-4083-bee7-4422d2f74cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:52.470851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 734/1467] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:52.516778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a5ab0-5fa9-4aea-bd88-2d38232c6709 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:52.531612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a5ab0-5fa9-4aea-bd88-2d38232c6709 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:52.537730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3cb38-af04-4c6c-834e-b2ffdb92b0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:52.538395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3cb38-af04-4c6c-834e-b2ffdb92b0a8 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:52.538679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3cb38-af04-4c6c-834e-b2ffdb92b0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:52.538954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3cb38-af04-4c6c-834e-b2ffdb92b0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:52.547288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3cb38-af04-4c6c-834e-b2ffdb92b0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:52.548922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3cb38-af04-4c6c-834e-b2ffdb92b0a8 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:52.558271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 734/1468] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:54.987693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079faa-aa3e-4a92-8a80-8a1512258411 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:54.988288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079faa-aa3e-4a92-8a80-8a1512258411 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:54.988288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079faa-aa3e-4a92-8a80-8a1512258411 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:54.990582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 735/1469] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:54.996441 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaf0f0-298d-468a-b31d-ba0d1e95be5d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:54.996867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaf0f0-298d-468a-b31d-ba0d1e95be5d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:54.997006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaf0f0-298d-468a-b31d-ba0d1e95be5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:55.015471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-68eaf0f0-298d-468a-b31d-ba0d1e95be5d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:55.016668 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-68eaf0f0-298d-468a-b31d-ba0d1e95be5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:55.024399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 735/1470] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:55.063564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a079faa-aa3e-4a92-8a80-8a1512258411 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:55.074034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a079faa-aa3e-4a92-8a80-8a1512258411 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:55.077546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2920-61d9-4062-b50f-73e8ce7efc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:55.078190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2920-61d9-4062-b50f-73e8ce7efc43 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:55.078486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2920-61d9-4062-b50f-73e8ce7efc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:55.078772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2920-61d9-4062-b50f-73e8ce7efc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:55.087391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2920-61d9-4062-b50f-73e8ce7efc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:55.088819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2920-61d9-4062-b50f-73e8ce7efc43 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:55.098105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 736/1471] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:57.445235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060a349-24e3-404e-9100-a21c56de9a01 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:57.445816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060a349-24e3-404e-9100-a21c56de9a01 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:57.445816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060a349-24e3-404e-9100-a21c56de9a01 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:57.447655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 736/1472] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:57.453676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceecccb-abf1-4532-af15-84f49b7523a8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:57.454108 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceecccb-abf1-4532-af15-84f49b7523a8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:57.454269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceecccb-abf1-4532-af15-84f49b7523a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:57.472847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4ceecccb-abf1-4532-af15-84f49b7523a8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:57.474055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4ceecccb-abf1-4532-af15-84f49b7523a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:57.487051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 737/1473] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:27:57.529063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060a349-24e3-404e-9100-a21c56de9a01 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:27:57.540269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060a349-24e3-404e-9100-a21c56de9a01 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:27:57.543811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648661a2-e635-4a5f-b624-d3acc1053120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:27:57.544449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648661a2-e635-4a5f-b624-d3acc1053120 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:57.544730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648661a2-e635-4a5f-b624-d3acc1053120 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:57.545003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648661a2-e635-4a5f-b624-d3acc1053120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:57.554281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648661a2-e635-4a5f-b624-d3acc1053120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:27:57.555705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648661a2-e635-4a5f-b624-d3acc1053120 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:27:57.564868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 737/1474] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:27:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:27:59.945839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436df3c-f79a-42ef-84ed-2de2382893fa None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:59.946363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436df3c-f79a-42ef-84ed-2de2382893fa None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:59.946459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436df3c-f79a-42ef-84ed-2de2382893fa None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:59.948227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 738/1475] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:27:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:27:59.954098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6d04-fac2-4662-89e4-0057b4918e0b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:27:59.954586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6d04-fac2-4662-89e4-0057b4918e0b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:27:59.954697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6d04-fac2-4662-89e4-0057b4918e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:27:59.973229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-41ce6d04-fac2-4662-89e4-0057b4918e0b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:27:59.975066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-41ce6d04-fac2-4662-89e4-0057b4918e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:27:59.982663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 738/1476] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:27:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:28:00.027005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436df3c-f79a-42ef-84ed-2de2382893fa None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:28:00.038290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436df3c-f79a-42ef-84ed-2de2382893fa None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:28:00.041825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6391b5-babf-4bee-9f42-a8c6898c845e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:28:00.042485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6391b5-babf-4bee-9f42-a8c6898c845e service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:28:00.042772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6391b5-babf-4bee-9f42-a8c6898c845e service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:28:00.043053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6391b5-babf-4bee-9f42-a8c6898c845e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:28:00.051817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6391b5-babf-4bee-9f42-a8c6898c845e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:28:00.053244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6391b5-babf-4bee-9f42-a8c6898c845e service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:28:00.062466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 739/1477] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:28:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:28:02.745574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3201-1ba1-496f-bd2e-0bc8452c318d None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:28:02.746127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3201-1ba1-496f-bd2e-0bc8452c318d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:28:02.746127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b3201-1ba1-496f-bd2e-0bc8452c318d None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:28:02.747925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 739/1478] 10.222.0.11 () {54 vars in 926 bytes} [Thu Nov 11 16:28:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:28:02.753744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede759-aca8-47f1-a391-c021a9776b40 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:28:02.754151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede759-aca8-47f1-a391-c021a9776b40 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:28:02.754338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede759-aca8-47f1-a391-c021a9776b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:28:02.773706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-01ede759-aca8-47f1-a391-c021a9776b40 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:28:02.774932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-01ede759-aca8-47f1-a391-c021a9776b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:28:02.782870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 740/1479] 10.222.0.11 () {58 vars in 1023 bytes} [Thu Nov 11 16:28:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:28:02.825486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b3201-1ba1-496f-bd2e-0bc8452c318d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:28:02.836546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b3201-1ba1-496f-bd2e-0bc8452c318d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:28:02.840047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b00e36-05f3-46c7-a3e5-ba6379925a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:28:02.840676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00e36-05f3-46c7-a3e5-ba6379925a23 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:28:02.840957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00e36-05f3-46c7-a3e5-ba6379925a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:28:02.841230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00e36-05f3-46c7-a3e5-ba6379925a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:28:02.850262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b00e36-05f3-46c7-a3e5-ba6379925a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:28:02.851696 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b00e36-05f3-46c7-a3e5-ba6379925a23 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:28:02.860726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 740/1480] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:28:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:30:01.218741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9491f4-622d-4998-a482-d986746fa0d8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.219327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9491f4-622d-4998-a482-d986746fa0d8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.219327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9491f4-622d-4998-a482-d986746fa0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.236814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ed9491f4-622d-4998-a482-d986746fa0d8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:30:01.237993 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ed9491f4-622d-4998-a482-d986746fa0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:30:01.246518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 741/1481] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:30:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:30:01.254554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260328-26ab-4387-9b8d-5e90c5923371 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.255579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260328-26ab-4387-9b8d-5e90c5923371 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.255692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260328-26ab-4387-9b8d-5e90c5923371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.273232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-07260328-26ab-4387-9b8d-5e90c5923371 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:30:01.274439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-07260328-26ab-4387-9b8d-5e90c5923371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:30:01.282136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 741/1482] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:30:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:30:01.286572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9491f4-622d-4998-a482-d986746fa0d8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:01.295958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9491f4-622d-4998-a482-d986746fa0d8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:01.300438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:01.301090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.301871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.302160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.303027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:30:01.303337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:01.305056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:01.316111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 742/1483] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:30:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:30:01.324463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260328-26ab-4387-9b8d-5e90c5923371 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:01.333757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260328-26ab-4387-9b8d-5e90c5923371 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:01.338281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:01.338909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.339195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.339470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.340166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:01.342049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:01.482263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 742/1484] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:30:01 2021] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:30:01.486479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:01.497376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869e23-bd94-41ed-9357-d36a22e90851 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:01.554427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:01.555099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.555384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.555662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.556391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:01.558458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:01.665030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 743/1485] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:30:01 2021] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:30:01.670726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:01.681595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffde7e-1fbe-4b9f-887f-b4a57d188fa9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:01.686054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:01.686738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.687028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.687308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.688052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:01.689650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:01.702806 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 743/1486] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:30:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:30:01.711841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:01.721421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8db78-6129-48ae-958d-eebdcef3927f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:01.726452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42777634-dff7-4d4d-8763-cf95095bc9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:01.727097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777634-dff7-4d4d-8763-cf95095bc9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.727378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777634-dff7-4d4d-8763-cf95095bc9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.727650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777634-dff7-4d4d-8763-cf95095bc9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.728386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42777634-dff7-4d4d-8763-cf95095bc9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:01.729954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42777634-dff7-4d4d-8763-cf95095bc9a7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:01.743816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 744/1487] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:30:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:30:01.747703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:01.757596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ddb0-b05c-4949-8428-dc7a0f55d6b1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:01.762241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:01.763102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.763383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.763667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] PATH_INFO: `/v3/projects/765d9a6bb28342aca6666edc55707ac3/users/f43d00423e1a45e8873adb395586e115/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.778209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765d9a6bb28342aca6666edc55707ac3, user_id=f43d00423e1a45e8873adb395586e115, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:01.780896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:01.856243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 744/1488] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:30:01 2021] PUT /identity/v3/projects/765d9a6bb28342aca6666edc55707ac3/users/f43d00423e1a45e8873adb395586e115/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:30:01.868049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8aa6-5516-46b3-8802-5332b02aac3a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:01.868347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8aa6-5516-46b3-8802-5332b02aac3a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:01.868630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a8aa6-5516-46b3-8802-5332b02aac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:01.894757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c55a8aa6-5516-46b3-8802-5332b02aac3a None None] MFA Rules not processed for user `f43d00423e1a45e8873adb395586e115`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:30:01.896543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c55a8aa6-5516-46b3-8802-5332b02aac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:30:01.963071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 745/1489] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:30:01 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:30:01.975467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:02.047174 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73c8cb-c3c9-4010-aa54-c22af276c307 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:02.053404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:02.054047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:02.054406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:02.054692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:02.062501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:02.064101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:02.073674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 745/1490] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:30:01 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:30:02.142663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dda82-823c-46f9-93bb-c3315fd63e63 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:02.142953 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dda82-823c-46f9-93bb-c3315fd63e63 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:02.143232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dda82-823c-46f9-93bb-c3315fd63e63 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:02.144944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 746/1491] 10.222.0.11 () {52 vars in 829 bytes} [Thu Nov 11 16:30:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:30:02.148756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:02.208719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a653363-bf56-4640-9a40-27738079afa0 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:02.213289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:02.214147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:02.214543 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:02.214759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] PATH_INFO: `/v3/users/f43d00423e1a45e8873adb395586e115` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:02.215951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43d00423e1a45e8873adb395586e115)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:02.216966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:30:02.216966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:30:02.216966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:30:02.218197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:02.465343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43d00423e1a45e8873adb395586e115'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:02.466072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43d00423e1a45e8873adb395586e115'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:02.485982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43d00423e1a45e8873adb395586e115'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:02.486707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43d00423e1a45e8873adb395586e115'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:02.564616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43d00423e1a45e8873adb395586e115'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:02.584095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 746/1492] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:30:02 2021] DELETE /identity/v3/users/f43d00423e1a45e8873adb395586e115 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:30:02.588496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:02.588966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:02.589074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:02.606647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:30:02.607827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:30:02.667141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 747/1493] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:30:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:30:02.677537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:02.678934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:30:02.733328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b026a-6972-44a2-aa26-737abd533733 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:02.736902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344560d-d4d2-40cb-94ab-45dcfd614d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:02.737567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344560d-d4d2-40cb-94ab-45dcfd614d04 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:02.737849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344560d-d4d2-40cb-94ab-45dcfd614d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:02.738126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344560d-d4d2-40cb-94ab-45dcfd614d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:02.747426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344560d-d4d2-40cb-94ab-45dcfd614d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:02.748852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344560d-d4d2-40cb-94ab-45dcfd614d04 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:02.758547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 747/1494] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:30:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:30:03.275647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:30:03.277087 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:30:03.292280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36a793-8e92-4e17-8c55-453f67648dec None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:30:03.299225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:30:03.300304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:30:03.300624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:30:03.300876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] PATH_INFO: `/v3/projects/765d9a6bb28342aca6666edc55707ac3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:30:03.302162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=765d9a6bb28342aca6666edc55707ac3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:30:03.305133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:30:03.305133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:30:03.305133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:30:03.306416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:30:03.423322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765d9a6bb28342aca6666edc55707ac3', 'request_id': 'req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:03.437011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765d9a6bb28342aca6666edc55707ac3', 'request_id': 'req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:03.498258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765d9a6bb28342aca6666edc55707ac3', 'request_id': 'req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:03.510741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] The token cache is being invalidate because project 765d9a6bb28342aca6666edc55707ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:30:03.511033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:03.511777 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3511b6fd-09b6-4c9b-93f1-b9e07e111f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:30:03.513325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 748/1495] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:30:03 2021] DELETE /identity/v3/projects/765d9a6bb28342aca6666edc55707ac3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:31:36.189851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa09b-e967-4d36-8d68-e2a663c37a7c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:36.190457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa09b-e967-4d36-8d68-e2a663c37a7c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:36.190457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa09b-e967-4d36-8d68-e2a663c37a7c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:36.192232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 748/1496] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 16:31:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:31:36.197501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411a79f-34a9-4433-9c87-f8784705d1f1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:36.198581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411a79f-34a9-4433-9c87-f8784705d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:36.198718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411a79f-34a9-4433-9c87-f8784705d1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:36.216350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3411a79f-34a9-4433-9c87-f8784705d1f1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:36.217555 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3411a79f-34a9-4433-9c87-f8784705d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:36.273763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 749/1497] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 16:31:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:31:36.427659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fa09b-e967-4d36-8d68-e2a663c37a7c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:31:36.429524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4a3fa09b-e967-4d36-8d68-e2a663c37a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:36.503459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fa09b-e967-4d36-8d68-e2a663c37a7c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:31:36.508779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156f2b7-5f40-4b63-8083-255dd9796200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:31:36.509408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f2b7-5f40-4b63-8083-255dd9796200 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:36.509688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f2b7-5f40-4b63-8083-255dd9796200 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:36.509958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f2b7-5f40-4b63-8083-255dd9796200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:36.519282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156f2b7-5f40-4b63-8083-255dd9796200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:31:36.520933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156f2b7-5f40-4b63-8083-255dd9796200 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:31:36.530106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 749/1498] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:31:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:31:37.507196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ce46-5f6b-4252-8dc9-80bcb3fd9c9a None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:37.507845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ce46-5f6b-4252-8dc9-80bcb3fd9c9a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:37.507954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ce46-5f6b-4252-8dc9-80bcb3fd9c9a None None] PATH_INFO: `/v3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:37.509358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 750/1499] 10.222.0.70 () {54 vars in 925 bytes} [Thu Nov 11 16:31:37 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:31:37.521604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43cc60-83d3-46da-9d96-c50c65ef6ee9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:37.522066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43cc60-83d3-46da-9d96-c50c65ef6ee9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:37.522218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43cc60-83d3-46da-9d96-c50c65ef6ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:37.541751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9d43cc60-83d3-46da-9d96-c50c65ef6ee9 None None] MFA Rules not processed for user `c8a0c26778994b0c93541400cde47bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:37.542979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9d43cc60-83d3-46da-9d96-c50c65ef6ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:37.603651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 750/1500] 10.222.0.70 () {58 vars in 1015 bytes} [Thu Nov 11 16:31:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:31:37.972665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955787e-01ad-4bc3-8c00-82a3895d743a None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:37.972955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955787e-01ad-4bc3-8c00-82a3895d743a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:37.973230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955787e-01ad-4bc3-8c00-82a3895d743a None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:37.975045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 751/1501] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 16:31:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:31:37.980713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596553-125b-46b2-ab91-950e4ddf83e6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:37.981008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596553-125b-46b2-ab91-950e4ddf83e6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:37.981285 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596553-125b-46b2-ab91-950e4ddf83e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:38.000159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e2596553-125b-46b2-ab91-950e4ddf83e6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:38.001411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e2596553-125b-46b2-ab91-950e4ddf83e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:38.009089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 751/1502] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 16:31:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:31:38.162965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955787e-01ad-4bc3-8c00-82a3895d743a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:31:38.177916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955787e-01ad-4bc3-8c00-82a3895d743a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:31:38.183957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963b4d-fd01-402b-a57e-873985edba2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:31:38.184580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963b4d-fd01-402b-a57e-873985edba2d service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:38.184872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963b4d-fd01-402b-a57e-873985edba2d service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:38.185144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963b4d-fd01-402b-a57e-873985edba2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:38.193152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963b4d-fd01-402b-a57e-873985edba2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:31:38.194793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963b4d-fd01-402b-a57e-873985edba2d service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:31:38.204553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 752/1503] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:31:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:31:41.875569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04dba5-bfbd-4336-9862-cd75d5d5998b None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:41.876038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04dba5-bfbd-4336-9862-cd75d5d5998b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:41.876154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04dba5-bfbd-4336-9862-cd75d5d5998b None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:41.877914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 752/1504] 10.222.0.11 () {54 vars in 960 bytes} [Thu Nov 11 16:31:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:31:41.883362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb6e6-8b22-4deb-80a5-763d4ac2a94d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:41.883795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb6e6-8b22-4deb-80a5-763d4ac2a94d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:41.883904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb6e6-8b22-4deb-80a5-763d4ac2a94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:41.903502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1c3fb6e6-8b22-4deb-80a5-763d4ac2a94d None None] MFA Rules not processed for user `c8a0c26778994b0c93541400cde47bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:41.909099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1c3fb6e6-8b22-4deb-80a5-763d4ac2a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:41.912917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 753/1505] 10.222.0.11 () {58 vars in 1057 bytes} [Thu Nov 11 16:31:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:31:41.920726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04dba5-bfbd-4336-9862-cd75d5d5998b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:31:41.933893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04dba5-bfbd-4336-9862-cd75d5d5998b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:31:41.938854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690ac5c-1c51-4bf2-b8a1-2397a3131f02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a0c26778994b0c93541400cde47bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:31:41.939511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690ac5c-1c51-4bf2-b8a1-2397a3131f02 service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:41.939794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690ac5c-1c51-4bf2-b8a1-2397a3131f02 service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:41.940072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690ac5c-1c51-4bf2-b8a1-2397a3131f02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:41.948793 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690ac5c-1c51-4bf2-b8a1-2397a3131f02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:31:41.950416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690ac5c-1c51-4bf2-b8a1-2397a3131f02 service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:31:41.959763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 753/1506] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:31:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:31:50.063829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d72203-8585-46a1-a984-e010fd8b5fd5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:50.064301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d72203-8585-46a1-a984-e010fd8b5fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:50.064409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d72203-8585-46a1-a984-e010fd8b5fd5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:50.066204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 754/1507] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 16:31:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:31:50.071699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b657-26aa-4a60-b6f9-7b2d52312bc3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:50.072130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b657-26aa-4a60-b6f9-7b2d52312bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:50.072325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727b657-26aa-4a60-b6f9-7b2d52312bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:50.091840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3727b657-26aa-4a60-b6f9-7b2d52312bc3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:50.093151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3727b657-26aa-4a60-b6f9-7b2d52312bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:50.101227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 754/1508] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 16:31:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:31:50.253906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d72203-8585-46a1-a984-e010fd8b5fd5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:31:50.268282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d72203-8585-46a1-a984-e010fd8b5fd5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:31:50.273725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c6f21-f844-4901-a341-7fd51222c578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:31:50.274385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c6f21-f844-4901-a341-7fd51222c578 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:50.274666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c6f21-f844-4901-a341-7fd51222c578 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:50.274939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c6f21-f844-4901-a341-7fd51222c578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:50.283290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c6f21-f844-4901-a341-7fd51222c578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:31:50.284856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c6f21-f844-4901-a341-7fd51222c578 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:31:50.293904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 755/1509] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:31:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:31:51.714646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ea09f-5308-4ba6-a960-59edf1170785 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:51.715255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ea09f-5308-4ba6-a960-59edf1170785 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:51.715255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ea09f-5308-4ba6-a960-59edf1170785 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:51.716965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 755/1510] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 16:31:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:31:51.722291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ea3d-3a05-4197-a49c-5a56154c43e7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:51.722765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ea3d-3a05-4197-a49c-5a56154c43e7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:51.722876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9ea3d-3a05-4197-a49c-5a56154c43e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:51.740552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-36c9ea3d-3a05-4197-a49c-5a56154c43e7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:51.741742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-36c9ea3d-3a05-4197-a49c-5a56154c43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:51.749520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 756/1511] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 16:31:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:31:51.906061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ea09f-5308-4ba6-a960-59edf1170785 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:31:51.919941 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ea09f-5308-4ba6-a960-59edf1170785 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:31:51.925166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3758575-18f2-4b0a-80a9-d8f100be95ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:31:51.925781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758575-18f2-4b0a-80a9-d8f100be95ee service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:51.926059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758575-18f2-4b0a-80a9-d8f100be95ee service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:51.926357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3758575-18f2-4b0a-80a9-d8f100be95ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:51.934712 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3758575-18f2-4b0a-80a9-d8f100be95ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:31:51.936285 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3758575-18f2-4b0a-80a9-d8f100be95ee service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:31:51.945320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 756/1512] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:31:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:31:56.318255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cacc98-1db7-42d9-bd47-338b21a56ce4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:56.318775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cacc98-1db7-42d9-bd47-338b21a56ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:56.318775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cacc98-1db7-42d9-bd47-338b21a56ce4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:56.320530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 757/1513] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 16:31:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:31:56.327765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981a892-6f1a-4364-a89b-cb89040d9825 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:56.328183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981a892-6f1a-4364-a89b-cb89040d9825 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:56.328330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981a892-6f1a-4364-a89b-cb89040d9825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:56.346162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7981a892-6f1a-4364-a89b-cb89040d9825 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:56.347399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7981a892-6f1a-4364-a89b-cb89040d9825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:56.356061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 757/1514] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 16:31:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:31:56.394759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cacc98-1db7-42d9-bd47-338b21a56ce4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:31:56.396471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-60cacc98-1db7-42d9-bd47-338b21a56ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:56.454969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cacc98-1db7-42d9-bd47-338b21a56ce4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:31:56.458505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0061-27f9-4ccf-9516-d0a701452344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:31:56.459142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0061-27f9-4ccf-9516-d0a701452344 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:56.459423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0061-27f9-4ccf-9516-d0a701452344 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:56.459712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0061-27f9-4ccf-9516-d0a701452344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:56.469680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0061-27f9-4ccf-9516-d0a701452344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:31:56.471148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0061-27f9-4ccf-9516-d0a701452344 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:31:56.481299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 758/1515] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:31:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:31:58.795108 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c9b4-3439-457c-811d-21ee325deeda None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:58.795681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c9b4-3439-457c-811d-21ee325deeda None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:58.795681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c9b4-3439-457c-811d-21ee325deeda None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:58.797417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 16:31:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:31:58.803339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8490-907e-40c1-8d39-0ec06f4f0ee3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:58.803813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8490-907e-40c1-8d39-0ec06f4f0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:58.803919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb8490-907e-40c1-8d39-0ec06f4f0ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:58.822561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e6bb8490-907e-40c1-8d39-0ec06f4f0ee3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:31:58.824837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e6bb8490-907e-40c1-8d39-0ec06f4f0ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:31:58.832536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 16:31:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:31:58.872903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200c9b4-3439-457c-811d-21ee325deeda None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:31:58.883585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200c9b4-3439-457c-811d-21ee325deeda None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:31:58.888235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36611ca-a592-4544-9ed0-1791d7238b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:31:58.892908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36611ca-a592-4544-9ed0-1791d7238b68 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:31:58.892908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36611ca-a592-4544-9ed0-1791d7238b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:31:58.892908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36611ca-a592-4544-9ed0-1791d7238b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:31:58.898414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36611ca-a592-4544-9ed0-1791d7238b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:31:58.899837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36611ca-a592-4544-9ed0-1791d7238b68 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:31:58.909446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 759/1518] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:31:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:32:02.715440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e5602-d0ac-4163-88e5-e1c29c7450f4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:02.716090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e5602-d0ac-4163-88e5-e1c29c7450f4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:02.716090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e5602-d0ac-4163-88e5-e1c29c7450f4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:02.717890 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 760/1519] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 16:32:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:32:02.723825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5764c-fbc0-400c-a30f-5e6e7159ad15 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:02.724253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5764c-fbc0-400c-a30f-5e6e7159ad15 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:02.724391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5764c-fbc0-400c-a30f-5e6e7159ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:02.742739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-16c5764c-fbc0-400c-a30f-5e6e7159ad15 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:32:02.743990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-16c5764c-fbc0-400c-a30f-5e6e7159ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:32:02.752165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 760/1520] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 16:32:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:32:02.805433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e5602-d0ac-4163-88e5-e1c29c7450f4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:32:02.807048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-652e5602-d0ac-4163-88e5-e1c29c7450f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:32:02.862667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e5602-d0ac-4163-88e5-e1c29c7450f4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:32:02.866114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aed95f-50d3-4ea2-b80f-d408498cbc17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:32:02.866776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aed95f-50d3-4ea2-b80f-d408498cbc17 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:02.867053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aed95f-50d3-4ea2-b80f-d408498cbc17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:02.867324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aed95f-50d3-4ea2-b80f-d408498cbc17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:02.876228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aed95f-50d3-4ea2-b80f-d408498cbc17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:32:02.877635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aed95f-50d3-4ea2-b80f-d408498cbc17 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:32:02.887104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 761/1521] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:32:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:32:05.183799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69c6d-17a9-430a-b230-d74b9a380760 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:05.184388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69c6d-17a9-430a-b230-d74b9a380760 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:05.184388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69c6d-17a9-430a-b230-d74b9a380760 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:05.186119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 16:32:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:32:05.191942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b1f8-0475-4f08-a3a9-1f9baaa1ccfe None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:05.192379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b1f8-0475-4f08-a3a9-1f9baaa1ccfe None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:05.192493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b1f8-0475-4f08-a3a9-1f9baaa1ccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:05.210625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-16c6b1f8-0475-4f08-a3a9-1f9baaa1ccfe None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:32:05.211765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-16c6b1f8-0475-4f08-a3a9-1f9baaa1ccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:32:05.219989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 16:32:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:32:05.272581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5aa0e-3c1b-4beb-b116-2c32ec0104e9 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:05.272863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5aa0e-3c1b-4beb-b116-2c32ec0104e9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:05.273143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5aa0e-3c1b-4beb-b116-2c32ec0104e9 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:05.275042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 762/1524] 10.222.0.11 () {54 vars in 962 bytes} [Thu Nov 11 16:32:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:32:05.281006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab4bb-1d97-4f20-9544-56dbad641a9c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:05.281292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab4bb-1d97-4f20-9544-56dbad641a9c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:05.281569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab4bb-1d97-4f20-9544-56dbad641a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:05.300691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3afab4bb-1d97-4f20-9544-56dbad641a9c None None] MFA Rules not processed for user `a90779e40db745b3ba36fe213880bb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:32:05.301868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3afab4bb-1d97-4f20-9544-56dbad641a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:32:05.308404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 763/1525] 10.222.0.11 () {58 vars in 1059 bytes} [Thu Nov 11 16:32:05 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:32:05.316331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5aa0e-3c1b-4beb-b116-2c32ec0104e9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:32:05.327643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5aa0e-3c1b-4beb-b116-2c32ec0104e9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:32:05.331146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d1c42-dcf7-4bad-9b1e-27681f0491c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:32:05.331774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1c42-dcf7-4bad-9b1e-27681f0491c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:32:05.332057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1c42-dcf7-4bad-9b1e-27681f0491c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:32:05.332332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1c42-dcf7-4bad-9b1e-27681f0491c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:32:05.342784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d1c42-dcf7-4bad-9b1e-27681f0491c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:32:05.344229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d1c42-dcf7-4bad-9b1e-27681f0491c8 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:32:05.353605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 763/1526] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:32:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:29.394820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f524a-00ae-4550-a00a-5c5902f75936 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.395410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f524a-00ae-4550-a00a-5c5902f75936 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.395410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f524a-00ae-4550-a00a-5c5902f75936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.413436 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6e3f524a-00ae-4550-a00a-5c5902f75936 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.414661 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6e3f524a-00ae-4550-a00a-5c5902f75936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.429079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 764/1527] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.437797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b944-3aef-4c0b-a132-5e092547f7a6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.438733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b944-3aef-4c0b-a132-5e092547f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.439236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b944-3aef-4c0b-a132-5e092547f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.466886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d677b944-3aef-4c0b-a132-5e092547f7a6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.468109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d677b944-3aef-4c0b-a132-5e092547f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.477820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 764/1528] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.482900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f524a-00ae-4550-a00a-5c5902f75936 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:29.492694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f524a-00ae-4550-a00a-5c5902f75936 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:29.503452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb556-6d82-462e-94da-99c1af73495b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.503779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb556-6d82-462e-94da-99c1af73495b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.504034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bb556-6d82-462e-94da-99c1af73495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.505330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:29.506001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.506317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.506594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.507345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:29.507652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:29.509397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:29.527996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d36bb556-6d82-462e-94da-99c1af73495b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.528417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 765/1529] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:29.529199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d36bb556-6d82-462e-94da-99c1af73495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.537517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:29.548150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 765/1530] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.552760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4f578-3fed-4361-b88b-3914dd54f553 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:29.558060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490940-ff00-4759-b351-39f6828163e1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.558461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490940-ff00-4759-b351-39f6828163e1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.559260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490940-ff00-4759-b351-39f6828163e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.572465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74aae6-ea56-4aa0-ba63-9ea2002183a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:29.573141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74aae6-ea56-4aa0-ba63-9ea2002183a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.573427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74aae6-ea56-4aa0-ba63-9ea2002183a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.573707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74aae6-ea56-4aa0-ba63-9ea2002183a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.574614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74aae6-ea56-4aa0-ba63-9ea2002183a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:29.576596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74aae6-ea56-4aa0-ba63-9ea2002183a7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:29.584255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b2490940-ff00-4759-b351-39f6828163e1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.585464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b2490940-ff00-4759-b351-39f6828163e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.607796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 766/1531] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.613590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2490940-ff00-4759-b351-39f6828163e1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:29.628181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2490940-ff00-4759-b351-39f6828163e1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:29.636499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a41c4b-4a0a-4c16-bb75-8cdf244fd6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:29.637180 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a41c4b-4a0a-4c16-bb75-8cdf244fd6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.637515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a41c4b-4a0a-4c16-bb75-8cdf244fd6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.637737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a41c4b-4a0a-4c16-bb75-8cdf244fd6c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.638531 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a41c4b-4a0a-4c16-bb75-8cdf244fd6c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:29.638843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a41c4b-4a0a-4c16-bb75-8cdf244fd6c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:29.640820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a41c4b-4a0a-4c16-bb75-8cdf244fd6c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:29.659748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 767/1532] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:29.661001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9788a-f512-425a-9605-c87c2a56f06e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.661296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9788a-f512-425a-9605-c87c2a56f06e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.661579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9788a-f512-425a-9605-c87c2a56f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.688047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-67d9788a-f512-425a-9605-c87c2a56f06e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.689266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-67d9788a-f512-425a-9605-c87c2a56f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.698095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 768/1533] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.702200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b7c1-9d14-44cb-a08a-91fcebbcbe95 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.702200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b7c1-9d14-44cb-a08a-91fcebbcbe95 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.702200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b7c1-9d14-44cb-a08a-91fcebbcbe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.718980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7401b7c1-9d14-44cb-a08a-91fcebbcbe95 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.720231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7401b7c1-9d14-44cb-a08a-91fcebbcbe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.728472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 769/1534] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.733575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ddd92-d149-4355-814c-d920ddb67ea1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.733575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ddd92-d149-4355-814c-d920ddb67ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.733575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ddd92-d149-4355-814c-d920ddb67ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.733861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 766/1535] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/projects => generated 405 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:33:29.733861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23018f7-decf-40cf-ad0b-a8ae6bef3397 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.734391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23018f7-decf-40cf-ad0b-a8ae6bef3397 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.734864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23018f7-decf-40cf-ad0b-a8ae6bef3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.751865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-338ddd92-d149-4355-814c-d920ddb67ea1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.753056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-338ddd92-d149-4355-814c-d920ddb67ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.754736 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d23018f7-decf-40cf-ad0b-a8ae6bef3397 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.755933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d23018f7-decf-40cf-ad0b-a8ae6bef3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.815763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 767/1536] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.816963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23018f7-decf-40cf-ad0b-a8ae6bef3397 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:29.817282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 770/1537] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.818590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefeae2-41aa-433a-8826-c9fbcdb91686 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.818888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefeae2-41aa-433a-8826-c9fbcdb91686 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.819172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefeae2-41aa-433a-8826-c9fbcdb91686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.832344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23018f7-decf-40cf-ad0b-a8ae6bef3397 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:29.836676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ddefeae2-41aa-433a-8826-c9fbcdb91686 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.836979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f05ab-5d4e-4a71-8d0d-7465c08611bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:29.837636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f05ab-5d4e-4a71-8d0d-7465c08611bf admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.837857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ddefeae2-41aa-433a-8826-c9fbcdb91686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.837961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f05ab-5d4e-4a71-8d0d-7465c08611bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.838205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f05ab-5d4e-4a71-8d0d-7465c08611bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.838926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f05ab-5d4e-4a71-8d0d-7465c08611bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:29.841661 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f05ab-5d4e-4a71-8d0d-7465c08611bf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:29.846511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 771/1538] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.847766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f51510-1b23-4d13-9d60-e69c7a59dc45 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.848056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f51510-1b23-4d13-9d60-e69c7a59dc45 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.848333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f51510-1b23-4d13-9d60-e69c7a59dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.865608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-34f51510-1b23-4d13-9d60-e69c7a59dc45 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:29.866803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-34f51510-1b23-4d13-9d60-e69c7a59dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:29.875661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 772/1539] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:29.876443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f51510-1b23-4d13-9d60-e69c7a59dc45 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:29.885935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f51510-1b23-4d13-9d60-e69c7a59dc45 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:29.891274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee03f1-5ddd-425c-a454-1718168bea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:29.891912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee03f1-5ddd-425c-a454-1718168bea81 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.892453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee03f1-5ddd-425c-a454-1718168bea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.892729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee03f1-5ddd-425c-a454-1718168bea81 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:29.893470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee03f1-5ddd-425c-a454-1718168bea81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:29.895406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee03f1-5ddd-425c-a454-1718168bea81 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:29.988230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 768/1540] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:29.989591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503c4e0-1889-498b-8778-82cd8051b693 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:29.989885 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503c4e0-1889-498b-8778-82cd8051b693 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:29.990169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503c4e0-1889-498b-8778-82cd8051b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.008506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8503c4e0-1889-498b-8778-82cd8051b693 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:30.013922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8503c4e0-1889-498b-8778-82cd8051b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:30.016459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 773/1541] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/users => generated 303 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.020891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5575ad-ad29-41b2-ae43-03c03df20203 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.021185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5575ad-ad29-41b2-ae43-03c03df20203 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.021472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5575ad-ad29-41b2-ae43-03c03df20203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.038946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7f5575ad-ad29-41b2-ae43-03c03df20203 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:30.040173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7f5575ad-ad29-41b2-ae43-03c03df20203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:30.067288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 769/1542] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:30.069136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540aac7b-3abd-4108-8287-d129400a77d4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.069136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540aac7b-3abd-4108-8287-d129400a77d4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.069480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540aac7b-3abd-4108-8287-d129400a77d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.087649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-540aac7b-3abd-4108-8287-d129400a77d4 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:30.089040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-540aac7b-3abd-4108-8287-d129400a77d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:30.097284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 770/1543] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:30.098616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238c06-a583-431e-8d18-245d03251ee5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.098978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238c06-a583-431e-8d18-245d03251ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.099331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238c06-a583-431e-8d18-245d03251ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.106203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 774/1544] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:30.106203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5575ad-ad29-41b2-ae43-03c03df20203 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.110821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5575ad-ad29-41b2-ae43-03c03df20203 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.115427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.116071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.116356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.116634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.117405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:30.117714 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.118450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2e238c06-a583-431e-8d18-245d03251ee5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:30.119373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.119625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2e238c06-a583-431e-8d18-245d03251ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:30.127970 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 771/1545] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:30.130730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d55fd0-fc13-4175-87b7-d24d6e19a7c0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.130730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d55fd0-fc13-4175-87b7-d24d6e19a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.130730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d55fd0-fc13-4175-87b7-d24d6e19a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.133604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 775/1546] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:30.135103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.145607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8bcfa-f094-462b-a7a8-d8f969aeeef9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.149314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-77d55fd0-fc13-4175-87b7-d24d6e19a7c0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:30.150215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.150572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-77d55fd0-fc13-4175-87b7-d24d6e19a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:30.150866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.151149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.151424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.152201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.154283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.159466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 772/1547] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:30.160240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d55fd0-fc13-4175-87b7-d24d6e19a7c0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.170224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d55fd0-fc13-4175-87b7-d24d6e19a7c0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.175175 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.175858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.176136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.176407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.177170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.178766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.189206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 773/1548] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:30.190135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.199994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90f93-580e-4948-9ffa-5279274138e6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.204424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.205033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.205310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.205581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.206329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:30.206630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.208147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.219236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 774/1549] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:30.220153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.229262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d941c4-28ca-441f-8172-83ce60e0e9e7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.235746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f32586-14cc-4db4-90c6-00c9d20c0b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.235746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32586-14cc-4db4-90c6-00c9d20c0b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.235746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32586-14cc-4db4-90c6-00c9d20c0b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.235746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32586-14cc-4db4-90c6-00c9d20c0b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.236160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f32586-14cc-4db4-90c6-00c9d20c0b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:30.236343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f32586-14cc-4db4-90c6-00c9d20c0b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.237887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f32586-14cc-4db4-90c6-00c9d20c0b51 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.252977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 775/1550] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:30.252977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475852-bd33-4274-8fb6-de39795ce5dd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.252977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475852-bd33-4274-8fb6-de39795ce5dd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.252977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475852-bd33-4274-8fb6-de39795ce5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.269052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-85475852-bd33-4274-8fb6-de39795ce5dd None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:30.270259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-85475852-bd33-4274-8fb6-de39795ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:30.278417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 776/1551] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:30.278702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 776/1552] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.281751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.281874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85475852-bd33-4274-8fb6-de39795ce5dd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.289640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85475852-bd33-4274-8fb6-de39795ce5dd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.290674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4efb3-8d5d-4739-95b1-9c9b6bd4f201 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.294839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.295469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.295750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.295871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.296027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.296480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.296770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.296900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:30.297073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.297204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.297738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.298700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.299718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.310452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 777/1553] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:30.311292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.320569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90f0a-6f50-4230-947a-45f36ce7d2b9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.327603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.327603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.327603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.327603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.328028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:30.328028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.329462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.342045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 778/1554] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:30.342956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.351997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b9b7c-312f-4a88-bd86-bbbf167b979a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.356766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.357383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.358277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.358277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.358657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.360188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.369722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 779/1555] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:30.370613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.380039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7aad2-b2b6-426f-82d9-30a60511d096 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.387813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 777/1556] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.387813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.388062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.388062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.388062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.388062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.388402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.389458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.443940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d493ef-8989-43a3-9a6d-3a0c6b30eb40 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.448550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.450041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.450434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.450708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.451423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.453333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.472971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 780/1557] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.476835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.532338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bbbb3-f9c4-475c-8a4e-0e9be9c0f292 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.536996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.540656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.540656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.540656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.540656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.540656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.544304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 778/1558] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.545205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.551337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 781/1559] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:30.552360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.562437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46558c3d-2b9a-49cd-a6d9-90d5523ca3e6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.607026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd35303-d2f0-4414-ab6f-76591b64bb7e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.611664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.612319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.612596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.612868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.613605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:30.613910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.615568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.617058 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.617717 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.617995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.618297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.619006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.621418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.627825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 779/1560] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:30.628608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.638878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba43a3a-e398-4b53-a354-3652162fedf9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.643800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.649198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.649198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.649198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.649198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.649198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.752235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 782/1561] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.753248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.760589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 780/1562] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.762259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.814508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6a66e-7745-46d5-af9b-b14914ae08cb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.819116 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.820027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.820317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.820598 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] PATH_INFO: `/v3/projects/51ac5d936a1e49f1a26a9c2927b461b4/users/74a18eed802442cfb0f398d3e2250936/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.821829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831561f-50e1-4030-b33f-de0a632b145d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.827308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.827961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.828241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.828520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.829218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.831182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.835565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ac5d936a1e49f1a26a9c2927b461b4, user_id=74a18eed802442cfb0f398d3e2250936, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.838246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.961674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 781/1563] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:30.962670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:30.972066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1562-f731-4673-9935-aa2636eb4492 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:30.976665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:30.977295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:30.977577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:30.977849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:30.978566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:30.980449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:30.990122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 783/1564] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:30 2021] PUT /identity/v3/projects/51ac5d936a1e49f1a26a9c2927b461b4/users/74a18eed802442cfb0f398d3e2250936/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:30.996927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.049757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e8d1-c7ff-4cce-94fa-70fa73cd000d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.054484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.055143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.055428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.055742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.056451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.058383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.085847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 782/1565] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:31.085847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.094532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a8b7b-dcce-4b06-860b-55b11d52e991 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.099131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.099786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.100094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.100369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.101098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.102727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.112867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 783/1566] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.114030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.122957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b02e-0ba9-4c83-a839-39f1cc01fe03 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.127567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.128167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.128452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.128721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.129406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.131314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.164146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 784/1567] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:30 2021] POST /identity/v3/users => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:31.164946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.174109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c00a57-3c84-42fb-bb69-5c61bafbbb59 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.178776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.179426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.179696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.180021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.180696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.182636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.220212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 784/1568] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:31 2021] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:31.221018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.280235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d5ec0-84be-4173-9eed-ca630bdc9b39 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.284900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.285557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.285843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.286125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.286854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.288773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.304231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 785/1569] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:31 2021] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:31.305207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.315358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cd147-1763-4acc-90ab-f012321d5053 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.320010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf838f8-3952-4ec2-95de-53c13aaaec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.320652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf838f8-3952-4ec2-95de-53c13aaaec95 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.320940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf838f8-3952-4ec2-95de-53c13aaaec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.321217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf838f8-3952-4ec2-95de-53c13aaaec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.322281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf838f8-3952-4ec2-95de-53c13aaaec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.323865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf838f8-3952-4ec2-95de-53c13aaaec95 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.334979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 786/1570] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.338768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5487-3bf3-453f-8324-f134404e31b1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.338768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5487-3bf3-453f-8324-f134404e31b1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.338768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5487-3bf3-453f-8324-f134404e31b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.361554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8ebd5487-3bf3-453f-8324-f134404e31b1 None None] MFA Rules not processed for user `74a18eed802442cfb0f398d3e2250936`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:31.362799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8ebd5487-3bf3-453f-8324-f134404e31b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:31.396860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 785/1571] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:31 2021] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:31.396860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.404132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935bb33-d5e9-49ac-87ff-d64531cdfdb5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.408879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.409518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.409807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.410082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.410892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.412525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.423605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 786/1572] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.423605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.427829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 787/1573] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:31 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:31.427829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5487-3bf3-453f-8324-f134404e31b1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.432847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f31190-15c7-44bf-9d78-2ff602ff9635 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.437399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5487-3bf3-453f-8324-f134404e31b1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.438221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.439088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.439418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.439695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] PATH_INFO: `/v3/projects/995594f22a2641a5a6056b04bdcf60c9/users/01987e7fb04b44bcbe2c57f635fb5e4e/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.442289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.442934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.443221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.443503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.444254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.445890 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.454761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] RBAC: Authorizing `identity:create_grant(project_id=995594f22a2641a5a6056b04bdcf60c9, user_id=01987e7fb04b44bcbe2c57f635fb5e4e, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.456643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 788/1574] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.457262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.457383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.466728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c3b0-f504-49e8-95fb-5dd3940cca89 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.471700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.472357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.472699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.472983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.473688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.475627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.538377 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 787/1575] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:31 2021] PUT /identity/v3/projects/995594f22a2641a5a6056b04bdcf60c9/users/01987e7fb04b44bcbe2c57f635fb5e4e/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:31.539228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.566019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 789/1576] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:31 2021] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:31.566019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.575280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5ef11-ebd2-4a53-8de1-431e12d80b5a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.601719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b6ed-8860-42fc-85fc-67167e89312b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.606464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.608291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.608582 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.608857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.609637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.611313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.621070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 788/1577] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.621924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.631963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465484-9ce2-460f-834c-30c2c77ac591 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.634016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.634744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.635029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.635308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.636060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.637034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.637660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.637768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.638001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.638412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.639387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.641034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.647797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 790/1578] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.648598 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.651266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 789/1579] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.651912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.658310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c1555-306d-41b0-9974-70302800bc18 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.661300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d96707-6b93-485b-97af-747c15d90e83 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.662899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.663551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.663839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.664117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.664856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.665916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.666467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.666597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.666849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.667126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.667816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.670560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.676726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 791/1580] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.677517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.689827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc194a28-4fda-43ca-af43-153d19060592 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.694413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af8c3-1e88-4a8c-8ff9-762ffd2a22cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.695079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af8c3-1e88-4a8c-8ff9-762ffd2a22cc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.698699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af8c3-1e88-4a8c-8ff9-762ffd2a22cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.698699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af8c3-1e88-4a8c-8ff9-762ffd2a22cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.698699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445af8c3-1e88-4a8c-8ff9-762ffd2a22cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.698699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445af8c3-1e88-4a8c-8ff9-762ffd2a22cc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.707529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 792/1581] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.708831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96b399-4875-447c-92c3-059dce9cbc86 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.709119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96b399-4875-447c-92c3-059dce9cbc86 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.709395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96b399-4875-447c-92c3-059dce9cbc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.726564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2b96b399-4875-447c-92c3-059dce9cbc86 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:31.727794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2b96b399-4875-447c-92c3-059dce9cbc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:31.735903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 793/1582] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:31.736762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96b399-4875-447c-92c3-059dce9cbc86 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.745891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96b399-4875-447c-92c3-059dce9cbc86 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.751018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.751651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.751930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.752202 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.752936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.754528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.764133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 794/1583] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.765010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.774106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c36f2f-4e13-4162-816c-f6d9a77e208b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.778725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.779337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.779617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.779891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.780603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.782137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.783448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 790/1584] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:31 2021] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:31.785039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.792577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 795/1585] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.793367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.803809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ac49-8a9a-4b04-a891-0686479c875a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.849162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5c9b-4ef1-48bb-b209-a924f646f2f6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.853882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.854735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.855014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.855292 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] PATH_INFO: `/v3/projects/9c7bfad662b4489c948dd2d07a15dce3/users/225b7f2ced804153841eb30dc6e99161/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.858332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.859000 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.859287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.859594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.860384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.861965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.870303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7bfad662b4489c948dd2d07a15dce3, user_id=225b7f2ced804153841eb30dc6e99161, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.871699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 796/1586] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:31.873260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:31.873765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.885028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc021-187d-49e6-abea-21e364f42ed5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:31.891165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:31.892461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:31.892748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:31.893025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] PATH_INFO: `/v3/projects/17202b7fa9ac43bc9736f2eed5c623f3/users/c0e12bd4237643e99e03e73f6c5c69f0/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:31.907789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=17202b7fa9ac43bc9736f2eed5c623f3, user_id=c0e12bd4237643e99e03e73f6c5c69f0, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:31.910633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:31.978692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 791/1587] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:31 2021] PUT /identity/v3/projects/9c7bfad662b4489c948dd2d07a15dce3/users/225b7f2ced804153841eb30dc6e99161/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:31.979628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.003525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 797/1588] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:31 2021] PUT /identity/v3/projects/17202b7fa9ac43bc9736f2eed5c623f3/users/c0e12bd4237643e99e03e73f6c5c69f0/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:32.003525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.043448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45847cb2-9ebc-4692-ad79-27a18a9be15d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.057940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f347a-20d4-4bab-a685-dbacefc0dddb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.061558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352661c-a524-4182-9626-30938d75866a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.062243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352661c-a524-4182-9626-30938d75866a service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.062543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352661c-a524-4182-9626-30938d75866a service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.062826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352661c-a524-4182-9626-30938d75866a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.101653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.102602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.102887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.103164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] PATH_INFO: `/v3/projects/2eb28cf941d546bebd002b1c0888fec7/users/16e979f73768419eb33322efdac16188/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.117683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb28cf941d546bebd002b1c0888fec7, user_id=16e979f73768419eb33322efdac16188, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.120302 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.123741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352661c-a524-4182-9626-30938d75866a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.125176 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352661c-a524-4182-9626-30938d75866a service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.134561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 798/1589] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:32.135337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352661c-a524-4182-9626-30938d75866a service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.144947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352661c-a524-4182-9626-30938d75866a service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.149898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.150583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.150873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.151249 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.152053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.154208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.164643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 799/1590] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:32.165483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.176127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb3651-fde3-4d44-8451-13060e566828 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.180770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.181403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.181688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.181985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.182769 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.184729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.198135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 792/1591] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:31 2021] PUT /identity/v3/projects/2eb28cf941d546bebd002b1c0888fec7/users/16e979f73768419eb33322efdac16188/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:32.198948 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.263703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b895b6d-7af4-41f9-8dcd-64f653417109 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.268935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a5651-cd41-4a6c-bda3-60781eb732a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.269853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5651-cd41-4a6c-bda3-60781eb732a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.270135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5651-cd41-4a6c-bda3-60781eb732a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.270448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a5651-cd41-4a6c-bda3-60781eb732a5 admin admin] PATH_INFO: `/v3/projects/e3792278fa6347cdafac78bd8c96f4be/users/216fbdbffa044efe905be6d19d11064e/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.284590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5651-cd41-4a6c-bda3-60781eb732a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3792278fa6347cdafac78bd8c96f4be, user_id=216fbdbffa044efe905be6d19d11064e, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.287299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a5651-cd41-4a6c-bda3-60781eb732a5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.306903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 800/1592] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:32 2021] POST /identity/v3/users => generated 309 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:32.307691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.318135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291f6eb-2c2f-41af-b5e9-d6c62f3ff1ca admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.323246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d19b77-2353-4336-9e84-273ac6e77046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.324199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d19b77-2353-4336-9e84-273ac6e77046 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.324483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d19b77-2353-4336-9e84-273ac6e77046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.324758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d19b77-2353-4336-9e84-273ac6e77046 admin admin] PATH_INFO: `/v3/projects/9f992c2ec055454ead0dacb22a5a1187/users/4514d443d8ce47308af5a772b5c6de57/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.340114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d19b77-2353-4336-9e84-273ac6e77046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f992c2ec055454ead0dacb22a5a1187, user_id=4514d443d8ce47308af5a772b5c6de57, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.342777 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d19b77-2353-4336-9e84-273ac6e77046 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.388174 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 793/1593] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:32 2021] PUT /identity/v3/projects/e3792278fa6347cdafac78bd8c96f4be/users/216fbdbffa044efe905be6d19d11064e/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:32.390436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760e7ab-e290-4988-90ce-68efd84dee48 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.390953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760e7ab-e290-4988-90ce-68efd84dee48 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.391514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760e7ab-e290-4988-90ce-68efd84dee48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.411861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 801/1594] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:32 2021] PUT /identity/v3/projects/9f992c2ec055454ead0dacb22a5a1187/users/4514d443d8ce47308af5a772b5c6de57/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:32.413792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e0ec-33ef-4335-a00e-adc00bf304e1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.414081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e0ec-33ef-4335-a00e-adc00bf304e1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.414383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165e0ec-33ef-4335-a00e-adc00bf304e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.421109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3760e7ab-e290-4988-90ce-68efd84dee48 None None] MFA Rules not processed for user `225b7f2ced804153841eb30dc6e99161`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:32.422364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3760e7ab-e290-4988-90ce-68efd84dee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:32.434295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a165e0ec-33ef-4335-a00e-adc00bf304e1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:32.437007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a165e0ec-33ef-4335-a00e-adc00bf304e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:32.496995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 794/1595] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:32 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:32.498483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760e7ab-e290-4988-90ce-68efd84dee48 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.504244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 802/1596] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:32.504244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0763-6c28-4be9-96d5-1921add18fb0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.504244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0763-6c28-4be9-96d5-1921add18fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.504244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0763-6c28-4be9-96d5-1921add18fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.509259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760e7ab-e290-4988-90ce-68efd84dee48 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.515141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.516400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.516742 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.517024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] PATH_INFO: `/v3/projects/1d082c8fe5b44353b0a5d447056451da/users/a0f4c53292cd456ea5596a97e5812764/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.522687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fcfe0763-6c28-4be9-96d5-1921add18fb0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:32.527104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fcfe0763-6c28-4be9-96d5-1921add18fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:32.535260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 803/1597] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:32.535260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0763-6c28-4be9-96d5-1921add18fb0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.540000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d082c8fe5b44353b0a5d447056451da, user_id=a0f4c53292cd456ea5596a97e5812764, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.542325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.546743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0763-6c28-4be9-96d5-1921add18fb0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.551517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5949dd7-991d-4116-9ae0-7e0fcfc1eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.556450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949dd7-991d-4116-9ae0-7e0fcfc1eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.556450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949dd7-991d-4116-9ae0-7e0fcfc1eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.556450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949dd7-991d-4116-9ae0-7e0fcfc1eb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.556450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5949dd7-991d-4116-9ae0-7e0fcfc1eb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.556450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5949dd7-991d-4116-9ae0-7e0fcfc1eb31 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.565866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 804/1598] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:32.567249 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27820dbc-6c58-47ec-b0fa-963716fd2c6e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.567547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27820dbc-6c58-47ec-b0fa-963716fd2c6e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.567820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27820dbc-6c58-47ec-b0fa-963716fd2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.585424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-27820dbc-6c58-47ec-b0fa-963716fd2c6e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:32.586649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-27820dbc-6c58-47ec-b0fa-963716fd2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:32.595333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 805/1599] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:32.596268 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81232d-6a1a-48cd-bb3c-192f0b278e3a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.596595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81232d-6a1a-48cd-bb3c-192f0b278e3a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.596927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81232d-6a1a-48cd-bb3c-192f0b278e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.615403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fe81232d-6a1a-48cd-bb3c-192f0b278e3a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:32.616574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fe81232d-6a1a-48cd-bb3c-192f0b278e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:32.624971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 806/1600] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:32.628146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81232d-6a1a-48cd-bb3c-192f0b278e3a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.636258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81232d-6a1a-48cd-bb3c-192f0b278e3a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.643226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 795/1601] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:32 2021] PUT /identity/v3/projects/1d082c8fe5b44353b0a5d447056451da/users/a0f4c53292cd456ea5596a97e5812764/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:32.646541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.732933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80ac20-58b8-4060-bb33-ba1727c97462 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.737105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.737780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.738056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.738391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.743343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.744113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.744465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.744828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.746171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.748283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.749159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.750676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.762443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 796/1602] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:32.762655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.771846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973231-cf95-44f8-bcf9-f08760895aa1 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.776328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.780172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.780172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.780172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.793024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.795395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.805286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 797/1603] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:32.805923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.815186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63c85c-a6f6-4dd2-a04e-2b157df5266a service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.819969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.820819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.821094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.821362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] PATH_INFO: `/v3/projects/1107a60b87bb4d40be50d0008360fb81/users/06a2e77390e540efa53fe50cc9480cf1/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.836055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1107a60b87bb4d40be50d0008360fb81, user_id=06a2e77390e540efa53fe50cc9480cf1, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.838758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:32.845804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 807/1604] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:32 2021] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:32.851657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.851657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:32.907460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f00e9-7ff7-4f28-9c8b-c1b8849d5931 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:32.911115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb8c2-7b01-4659-9b75-103850a4904f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:32.911761 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb8c2-7b01-4659-9b75-103850a4904f service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:32.912059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb8c2-7b01-4659-9b75-103850a4904f service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:32.912821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb8c2-7b01-4659-9b75-103850a4904f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:32.957022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 798/1605] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:32 2021] PUT /identity/v3/projects/1107a60b87bb4d40be50d0008360fb81/users/06a2e77390e540efa53fe50cc9480cf1/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:32.958347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:32.990460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cb8c2-7b01-4659-9b75-103850a4904f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:32.992008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cb8c2-7b01-4659-9b75-103850a4904f service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.003819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 808/1606] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:33.005220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814991-ec1d-4986-b418-47ad0661849d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.005517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814991-ec1d-4986-b418-47ad0661849d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.007128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814991-ec1d-4986-b418-47ad0661849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.035281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-79814991-ec1d-4986-b418-47ad0661849d None None] MFA Rules not processed for user `a0f4c53292cd456ea5596a97e5812764`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:33.036713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-79814991-ec1d-4986-b418-47ad0661849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:33.044537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87777144-a884-405f-9f97-de1944e41e8d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.051675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.052494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.053078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.053282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.110241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 809/1607] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:33.111363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814991-ec1d-4986-b418-47ad0661849d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.120308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.122004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.139492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 799/1608] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:33.139492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.144757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01785-7d13-42b8-b389-f62184bb5f54 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.149759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.150436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.150727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.151169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.151914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.153520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.164843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 800/1609] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:33.171449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.177541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781da80-ed46-4787-9a8c-ce91474f1e6e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.183920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.184822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.185931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.186439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.186961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814991-ec1d-4986-b418-47ad0661849d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.187263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.189600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.192573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.194090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.194719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.194719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.195711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.197705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.285071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 801/1610] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:33 2021] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:33.285071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.340089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 810/1611] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:33 2021] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:33.340089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.355090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0dad-c865-4a8c-a42a-c2e5c71ac0f6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.362442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442315-d5a7-48be-8e21-d00dae9bf5fa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.369348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.370646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.370804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.371326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.371529 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] PATH_INFO: `/v3/projects/1107a60b87bb4d40be50d0008360fb81/users/06a2e77390e540efa53fe50cc9480cf1/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.374009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.374595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.375110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.375713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1107a60b87bb4d40be50d0008360fb81, user_id=06a2e77390e540efa53fe50cc9480cf1, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.376316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.378462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.380333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.396299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 802/1612] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:33 2021] PUT /identity/v3/projects/1107a60b87bb4d40be50d0008360fb81/users/06a2e77390e540efa53fe50cc9480cf1/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:33.397255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.471165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e0f06-9661-4adb-9ed9-f9de46ad92d0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.476478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79707ec4-6d14-4a25-ad22-748324f11c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.476721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79707ec4-6d14-4a25-ad22-748324f11c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.478006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79707ec4-6d14-4a25-ad22-748324f11c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.478006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79707ec4-6d14-4a25-ad22-748324f11c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.478710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79707ec4-6d14-4a25-ad22-748324f11c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.480363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79707ec4-6d14-4a25-ad22-748324f11c9d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.490994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 803/1613] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:33.492394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b573269-1a37-4141-9f0c-62e15e501636 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.492685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b573269-1a37-4141-9f0c-62e15e501636 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.492961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b573269-1a37-4141-9f0c-62e15e501636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.517891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 811/1614] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:33 2021] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:33.518896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.527021 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6b573269-1a37-4141-9f0c-62e15e501636 None None] MFA Rules not processed for user `06a2e77390e540efa53fe50cc9480cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:33.529280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6b573269-1a37-4141-9f0c-62e15e501636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:33.555479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a51284-5975-4108-ae84-5a0516150191 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.565042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.565948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.566278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.566562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] PATH_INFO: `/v3/projects/1c512e929216481c811cffb158fc6a47/users/a2c2057fe24049ebb5d99bba11112a53/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.605940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c512e929216481c811cffb158fc6a47, user_id=a2c2057fe24049ebb5d99bba11112a53, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.612912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.630335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 804/1615] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:33 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:33.633577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b573269-1a37-4141-9f0c-62e15e501636 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.652328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b573269-1a37-4141-9f0c-62e15e501636 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.663344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.664356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.664645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.665562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.666388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.668045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.679660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 805/1616] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:33.680413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.691949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 812/1617] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:33 2021] PUT /identity/v3/projects/1c512e929216481c811cffb158fc6a47/users/a2c2057fe24049ebb5d99bba11112a53/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:33.693249 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.778517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9d4fb-568e-4ec0-b33f-26473ebfea9f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.825404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ada492-51c4-4ef7-aa1b-7be9697954da admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.832144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.833173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.833454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.833781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] PATH_INFO: `/v3/projects/9ee6c73ad05246fd9c7670f7d1c6811d/users/3e15268b7ad24c76a165c76ae2bebcac/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.869691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.871399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.871823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.872443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.883517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee6c73ad05246fd9c7670f7d1c6811d, user_id=3e15268b7ad24c76a165c76ae2bebcac, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.902343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.954065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.955773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:33.966277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 806/1618] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:33 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:33.968464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:33.977785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216eea9-260c-4d99-a7c8-2677837d6366 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:33.983713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482800d1-6f79-4089-8095-2e291af2283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:33.984393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482800d1-6f79-4089-8095-2e291af2283b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:33.984682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482800d1-6f79-4089-8095-2e291af2283b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:33.984965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482800d1-6f79-4089-8095-2e291af2283b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:33.985719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482800d1-6f79-4089-8095-2e291af2283b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:33.987357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482800d1-6f79-4089-8095-2e291af2283b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:34.001493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 807/1619] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:34.001493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5093b-d6e7-4c3d-a4f7-0cd410b4233a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.001493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5093b-d6e7-4c3d-a4f7-0cd410b4233a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.001493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5093b-d6e7-4c3d-a4f7-0cd410b4233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.027751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-51c5093b-d6e7-4c3d-a4f7-0cd410b4233a None None] MFA Rules not processed for user `01987e7fb04b44bcbe2c57f635fb5e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:34.029078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-51c5093b-d6e7-4c3d-a4f7-0cd410b4233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:34.085349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 813/1620] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:33 2021] PUT /identity/v3/projects/9ee6c73ad05246fd9c7670f7d1c6811d/users/3e15268b7ad24c76a165c76ae2bebcac/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:34.088773 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:34.119146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 808/1621] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:33 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:34.131925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5093b-d6e7-4c3d-a4f7-0cd410b4233a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:34.136261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5093b-d6e7-4c3d-a4f7-0cd410b4233a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:34.220838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c6867-469a-4bd4-8bab-587aeb8bf746 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:34.232726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6bfae-b7bb-47a6-b740-ad286110f7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:34.233850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6bfae-b7bb-47a6-b740-ad286110f7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.238083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6bfae-b7bb-47a6-b740-ad286110f7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.240363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6bfae-b7bb-47a6-b740-ad286110f7d0 admin admin] PATH_INFO: `/v3/projects/1c512e929216481c811cffb158fc6a47/users/a2c2057fe24049ebb5d99bba11112a53/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.245754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6bfae-b7bb-47a6-b740-ad286110f7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c512e929216481c811cffb158fc6a47, user_id=a2c2057fe24049ebb5d99bba11112a53, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:34.251794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6bfae-b7bb-47a6-b740-ad286110f7d0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:34.260399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:34.261245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.261420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.261704 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.262496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:34.264197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:34.282977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 814/1622] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:34 2021] PUT /identity/v3/projects/1c512e929216481c811cffb158fc6a47/users/a2c2057fe24049ebb5d99bba11112a53/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:34.288677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea6420-5994-42ab-afce-33d366f71695 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.288821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 809/1623] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:34 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:34.288913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea6420-5994-42ab-afce-33d366f71695 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.289221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea6420-5994-42ab-afce-33d366f71695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.301456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:34.324483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2aea6420-5994-42ab-afce-33d366f71695 None None] MFA Rules not processed for user `01987e7fb04b44bcbe2c57f635fb5e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:34.327088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2aea6420-5994-42ab-afce-33d366f71695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:34.329020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f94e8-e685-44e0-a068-6e7d3261df43 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:34.398766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 815/1624] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:34.400342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d757-71b2-459c-9a28-55a6171783a6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.400639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d757-71b2-459c-9a28-55a6171783a6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.400971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d757-71b2-459c-9a28-55a6171783a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.442128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8f80d757-71b2-459c-9a28-55a6171783a6 None None] MFA Rules not processed for user `a2c2057fe24049ebb5d99bba11112a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:34.443986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8f80d757-71b2-459c-9a28-55a6171783a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:34.446991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:34.448039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.448409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.448693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] PATH_INFO: `/v3/projects/9ee6c73ad05246fd9c7670f7d1c6811d/users/3e15268b7ad24c76a165c76ae2bebcac/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.451586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee6c73ad05246fd9c7670f7d1c6811d, user_id=3e15268b7ad24c76a165c76ae2bebcac, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:34.455006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:34.487364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 810/1625] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:34 2021] PUT /identity/v3/projects/9ee6c73ad05246fd9c7670f7d1c6811d/users/3e15268b7ad24c76a165c76ae2bebcac/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:34.487968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:34.543703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 816/1626] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:34 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:34.545751 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3081a-638e-4e94-a914-2e2ec16ea642 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.546045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3081a-638e-4e94-a914-2e2ec16ea642 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.546359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3081a-638e-4e94-a914-2e2ec16ea642 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.558837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 817/1627] 10.222.0.11 () {54 vars in 961 bytes} [Thu Nov 11 16:33:34 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:33:34.560056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a4b9-0a32-4b43-b7d2-09f07b4b723b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.560353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a4b9-0a32-4b43-b7d2-09f07b4b723b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.560643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a4b9-0a32-4b43-b7d2-09f07b4b723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.588217 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aad2e4-cd3d-4330-a675-e699ce9aecfc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:34.590541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4b34a4b9-0a32-4b43-b7d2-09f07b4b723b None None] MFA Rules not processed for user `3e15268b7ad24c76a165c76ae2bebcac`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:34.592534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4b34a4b9-0a32-4b43-b7d2-09f07b4b723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:34.594027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:34.594917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.595200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.595474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] PATH_INFO: `/v3/users/74a18eed802442cfb0f398d3e2250936` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.597103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a18eed802442cfb0f398d3e2250936)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:34.598935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:34.668079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 818/1628] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:34 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:34.668994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a4b9-0a32-4b43-b7d2-09f07b4b723b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:34.722356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a4b9-0a32-4b43-b7d2-09f07b4b723b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:34.726409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c3c90-cd7e-4125-a22e-9b29fb9dd41c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:34.727064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c3c90-cd7e-4125-a22e-9b29fb9dd41c service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.727400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c3c90-cd7e-4125-a22e-9b29fb9dd41c service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.727683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c3c90-cd7e-4125-a22e-9b29fb9dd41c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.784092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a18eed802442cfb0f398d3e2250936'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:34.785359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a18eed802442cfb0f398d3e2250936'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:34.801224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c3c90-cd7e-4125-a22e-9b29fb9dd41c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:34.801988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a18eed802442cfb0f398d3e2250936'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:34.807242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c3c90-cd7e-4125-a22e-9b29fb9dd41c service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:34.807428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a18eed802442cfb0f398d3e2250936'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:34.817947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 819/1629] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:34 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:34.819515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cd383-eaca-415e-a2ce-c97a28fe6782 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.819813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cd383-eaca-415e-a2ce-c97a28fe6782 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.820099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cd383-eaca-415e-a2ce-c97a28fe6782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.852063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-511cd383-eaca-415e-a2ce-c97a28fe6782 None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:34.853378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-511cd383-eaca-415e-a2ce-c97a28fe6782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:34.907109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a18eed802442cfb0f398d3e2250936'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:34.922591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 811/1630] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:34 2021] DELETE /identity/v3/users/74a18eed802442cfb0f398d3e2250936 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:34.923401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:34.924844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:34.937655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 820/1631] 10.222.0.11 () {58 vars in 1058 bytes} [Thu Nov 11 16:33:34 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:34.939184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65c79-8a5c-4a1b-bb0c-99c11a1c7096 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:34.939483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65c79-8a5c-4a1b-bb0c-99c11a1c7096 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:34.939868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65c79-8a5c-4a1b-bb0c-99c11a1c7096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:34.982426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e9d65c79-8a5c-4a1b-bb0c-99c11a1c7096 None None] MFA Rules not processed for user `16e979f73768419eb33322efdac16188`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:34.984195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e9d65c79-8a5c-4a1b-bb0c-99c11a1c7096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:35.007457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dd497-eccf-4a76-ae94-86e21930ff6f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:35.012592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:35.014085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.014524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.015469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.019002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:35.080466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 821/1632] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:34 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:35.081896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.082356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.082737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.104476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:35.113530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:35.150237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:35.150237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:35.168459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 812/1633] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:34 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:35.170269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:35.211584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 822/1634] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:35.212692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:35.214116 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:35.233078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86adb98-7dae-44c3-b6d9-c36a37680336 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:35.239389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:35.240059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.241404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.241667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.242480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:35.244438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:35.269719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a192b92-8165-4b3c-8c58-7c6b60102bd8 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:35.275314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b542d-1cd3-41cb-90be-fe2e58caa157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:35.276002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b542d-1cd3-41cb-90be-fe2e58caa157 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.276237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b542d-1cd3-41cb-90be-fe2e58caa157 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.276515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b542d-1cd3-41cb-90be-fe2e58caa157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.278415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b29b542d-1cd3-41cb-90be-fe2e58caa157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:35.370419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b542d-1cd3-41cb-90be-fe2e58caa157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:35.376619 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b542d-1cd3-41cb-90be-fe2e58caa157 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:35.380916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 823/1635] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:35 2021] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:35.382887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:35.388729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:35.401505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 813/1636] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:35 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:35.403357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4caf7-24c6-4dd7-81d6-f292d593e6cf None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.403557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4caf7-24c6-4dd7-81d6-f292d593e6cf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.406225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4caf7-24c6-4dd7-81d6-f292d593e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.462229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-11e4caf7-24c6-4dd7-81d6-f292d593e6cf None None] MFA Rules not processed for user `216fbdbffa044efe905be6d19d11064e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:35.463456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-11e4caf7-24c6-4dd7-81d6-f292d593e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:35.519515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f6e97-faf5-45e0-b6f0-d188b70eb0dd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:35.523933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:35.524716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.524964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.525339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.669808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 814/1637] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:35.671681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4caf7-24c6-4dd7-81d6-f292d593e6cf None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:35.730054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:35.742706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:35.751379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4caf7-24c6-4dd7-81d6-f292d593e6cf None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:35.769690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 824/1638] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:35.771224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:35.773995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a216c-7dd4-4a2f-a7e5-f61577c2c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:35.774795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a216c-7dd4-4a2f-a7e5-f61577c2c7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.775159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a216c-7dd4-4a2f-a7e5-f61577c2c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.775530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a216c-7dd4-4a2f-a7e5-f61577c2c7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.776655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a216c-7dd4-4a2f-a7e5-f61577c2c7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:35.783813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a216c-7dd4-4a2f-a7e5-f61577c2c7c4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:35.905700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6750024-c64b-4359-86d8-ef3813d7c91b service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:35.913171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433f898-77c2-4b90-82f9-0a010f1b2fed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:35.914069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f898-77c2-4b90-82f9-0a010f1b2fed service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:35.914577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f898-77c2-4b90-82f9-0a010f1b2fed service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:35.915032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433f898-77c2-4b90-82f9-0a010f1b2fed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:35.917785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6433f898-77c2-4b90-82f9-0a010f1b2fed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:36.001191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 815/1639] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:35 2021] POST /identity/v3/users => generated 308 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:36.001191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646eeb1-0080-4e2e-8266-2370ba39c0fb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.001191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646eeb1-0080-4e2e-8266-2370ba39c0fb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.001191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646eeb1-0080-4e2e-8266-2370ba39c0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.016742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433f898-77c2-4b90-82f9-0a010f1b2fed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.018640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433f898-77c2-4b90-82f9-0a010f1b2fed service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:36.022326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6646eeb1-0080-4e2e-8266-2370ba39c0fb None None] MFA Rules not processed for user `216fbdbffa044efe905be6d19d11064e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:36.027637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6646eeb1-0080-4e2e-8266-2370ba39c0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:36.029585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 825/1640] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:35 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:36.031543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048b226-1bb4-4fe6-86a1-5bd697b1b877 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.031943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048b226-1bb4-4fe6-86a1-5bd697b1b877 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.032324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048b226-1bb4-4fe6-86a1-5bd697b1b877 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.034711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 826/1641] 10.222.0.11 () {54 vars in 912 bytes} [Thu Nov 11 16:33:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:33:36.035663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048b226-1bb4-4fe6-86a1-5bd697b1b877 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:36.052797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048b226-1bb4-4fe6-86a1-5bd697b1b877 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:36.057970 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:36.058804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.059189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.059615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.061545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.063530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:36.070049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 816/1642] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:36.077916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb32185-ee51-4f8a-a920-be8ba9386e7c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.079420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb32185-ee51-4f8a-a920-be8ba9386e7c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.080760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb32185-ee51-4f8a-a920-be8ba9386e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.081862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 827/1643] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:36 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:36.086002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:36.099385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94602d92-4e83-4dec-8de4-847c5626340c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:36.105728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a8ffa-0ee0-486e-b4a8-20ad15b8dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:36.107933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8ffa-0ee0-486e-b4a8-20ad15b8dd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.108388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8ffa-0ee0-486e-b4a8-20ad15b8dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.108802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8ffa-0ee0-486e-b4a8-20ad15b8dd9a admin admin] PATH_INFO: `/v3/projects/c132430eaa744505817c92df3659da8e/users/5d4e9612e31d4c50a66daefaa2669021/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.125964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a8ffa-0ee0-486e-b4a8-20ad15b8dd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c132430eaa744505817c92df3659da8e, user_id=5d4e9612e31d4c50a66daefaa2669021, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.130870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a8ffa-0ee0-486e-b4a8-20ad15b8dd9a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:36.140755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0eb32185-ee51-4f8a-a920-be8ba9386e7c None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:36.143647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0eb32185-ee51-4f8a-a920-be8ba9386e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:36.220500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 828/1644] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:36 2021] PUT /identity/v3/projects/c132430eaa744505817c92df3659da8e/users/5d4e9612e31d4c50a66daefaa2669021/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:36.222026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4fd25-718c-4c66-a5d7-6a621a540dad None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.222874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4fd25-718c-4c66-a5d7-6a621a540dad None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.224650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4fd25-718c-4c66-a5d7-6a621a540dad None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.226715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 829/1645] 10.222.0.11 () {54 vars in 961 bytes} [Thu Nov 11 16:33:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:33:36.228536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4fd25-718c-4c66-a5d7-6a621a540dad None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:36.309126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 817/1646] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:33:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:36.311682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3860fe0-5a11-4208-a903-5cef0b79fedc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.312066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3860fe0-5a11-4208-a903-5cef0b79fedc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.312287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3860fe0-5a11-4208-a903-5cef0b79fedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.348498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b3860fe0-5a11-4208-a903-5cef0b79fedc None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:36.349995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b3860fe0-5a11-4208-a903-5cef0b79fedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:36.390784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4fd25-718c-4c66-a5d7-6a621a540dad None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:36.396390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:36.397197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.397586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.398062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.399019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.401544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:36.416541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 830/1647] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:36 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:36.417528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:36.421159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:36.511291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 818/1648] 10.222.0.11 () {58 vars in 1058 bytes} [Thu Nov 11 16:33:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:36.512804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3860fe0-5a11-4208-a903-5cef0b79fedc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:36.513201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfa644-e4bf-4dda-947d-96ffb8c25db9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:36.521426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:36.522312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.522619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.523129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.527841 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3860fe0-5a11-4208-a903-5cef0b79fedc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:36.539462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:36.542325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.542622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.542906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] PATH_INFO: `/v3/projects/c132430eaa744505817c92df3659da8e/users/5d4e9612e31d4c50a66daefaa2669021/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.548488 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c132430eaa744505817c92df3659da8e, user_id=5d4e9612e31d4c50a66daefaa2669021, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.551739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:36.563611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.564975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:36.587428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 819/1649] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:36 2021] PUT /identity/v3/projects/c132430eaa744505817c92df3659da8e/users/5d4e9612e31d4c50a66daefaa2669021/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:36.587428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:36.587634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 831/1650] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:36.741260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:36.742779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:36.748940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3b512-3ed1-4aa7-b5e1-fe06d8bcb3fc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:36.756947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470fb82-7c1c-4cd1-8151-e145bd1dbb07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:36.757805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470fb82-7c1c-4cd1-8151-e145bd1dbb07 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.758163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470fb82-7c1c-4cd1-8151-e145bd1dbb07 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.758527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470fb82-7c1c-4cd1-8151-e145bd1dbb07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.770653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3783b4a-1ce9-44ba-bab9-3bf5087c1704 service glance] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:36.846768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470fb82-7c1c-4cd1-8151-e145bd1dbb07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.848419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470fb82-7c1c-4cd1-8151-e145bd1dbb07 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:36.860739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 820/1651] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:36 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:36.935234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:36.936669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:36.936946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:36.937354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] PATH_INFO: `/v3/projects/51ac5d936a1e49f1a26a9c2927b461b4` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:36.941349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ac5d936a1e49f1a26a9c2927b461b4)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:36.943427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:37.180589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ac5d936a1e49f1a26a9c2927b461b4', 'request_id': 'req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.198259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ac5d936a1e49f1a26a9c2927b461b4', 'request_id': 'req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.291215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ac5d936a1e49f1a26a9c2927b461b4', 'request_id': 'req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.307757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abfba6-cfd2-49e4-bd72-e73d17a450c9 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:37.308435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abfba6-cfd2-49e4-bd72-e73d17a450c9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:37.308934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abfba6-cfd2-49e4-bd72-e73d17a450c9 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:37.311733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 821/1652] 10.222.0.11 () {54 vars in 912 bytes} [Thu Nov 11 16:33:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:33:37.320667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102cbe7-7051-47b4-99ed-e3fc64c1308b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:37.320667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102cbe7-7051-47b4-99ed-e3fc64c1308b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:37.320667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102cbe7-7051-47b4-99ed-e3fc64c1308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:37.349750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] The token cache is being invalidate because project 51ac5d936a1e49f1a26a9c2927b461b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:37.350069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.353169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.356452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 832/1653] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:36 2021] DELETE /identity/v3/projects/51ac5d936a1e49f1a26a9c2927b461b4 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:37.424578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:37.424578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:37.432238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8102cbe7-7051-47b4-99ed-e3fc64c1308b None None] MFA Rules not processed for user `25123d6cb4fc417899321ecdb3c76b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:37.432238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8102cbe7-7051-47b4-99ed-e3fc64c1308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:37.507624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15b74e-2d43-40e9-bbe1-a9e251e0a965 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:37.515734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:37.516888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:37.517485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:37.517771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] PATH_INFO: `/v3/users/06a2e77390e540efa53fe50cc9480cf1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:37.519316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a2e77390e540efa53fe50cc9480cf1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:37.521269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:33:37.521269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 11 16:33:37.521269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: Nov 11 16:33:37.523114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:37.561501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 822/1654] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:33:37 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:33:37.565394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5161-30d9-4121-a287-63a7d3174e8e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:37.565394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5161-30d9-4121-a287-63a7d3174e8e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:37.565394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5161-30d9-4121-a287-63a7d3174e8e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:37.566385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 823/1655] 10.222.0.11 () {54 vars in 912 bytes} [Thu Nov 11 16:33:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:33:37.579918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:37.580428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:37.580809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:37.602070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:37.605538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:37.671109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 824/1656] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:33:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:33:37.672132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:37.673437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:37.688377 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11169702-7351-4981-a004-9e7e87d7a765 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:37.694621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:37.694621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:37.694621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:37.694621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:37.703445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:37.708971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:37.719516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 825/1657] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:37.727682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:37.727682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:37.803109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a2e77390e540efa53fe50cc9480cf1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.822914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f28efe-b6b3-4903-81b2-a3f1e470588c service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:37.827981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99d603-2272-45f1-a1f4-fd6038595b39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:37.828820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99d603-2272-45f1-a1f4-fd6038595b39 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:37.829172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99d603-2272-45f1-a1f4-fd6038595b39 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:37.837990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a2e77390e540efa53fe50cc9480cf1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.838997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a2e77390e540efa53fe50cc9480cf1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.839787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a2e77390e540efa53fe50cc9480cf1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.842125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99d603-2272-45f1-a1f4-fd6038595b39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:37.849154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8a99d603-2272-45f1-a1f4-fd6038595b39 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:37.854028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-54313837-5bb1-4e6f-8bee-808a06b12f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a2e77390e540efa53fe50cc9480cf1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:37.874162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99d603-2272-45f1-a1f4-fd6038595b39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:37.876140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99d603-2272-45f1-a1f4-fd6038595b39 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:37.892624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 826/1658] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:37.976934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 833/1659] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:37 2021] DELETE /identity/v3/users/06a2e77390e540efa53fe50cc9480cf1 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:38.886645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea01e-dcf2-4d96-a6ee-01500413d55f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:38.887164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea01e-dcf2-4d96-a6ee-01500413d55f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:38.887265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ea01e-dcf2-4d96-a6ee-01500413d55f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:38.898119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 827/1660] 10.222.0.11 () {54 vars in 912 bytes} [Thu Nov 11 16:33:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:33:38.899079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:38.899079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:38.899079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:38.943078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] MFA Rules not processed for user `25123d6cb4fc417899321ecdb3c76b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:38.946791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:39.035864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 834/1661] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:33:38 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:39.064306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea01e-dcf2-4d96-a6ee-01500413d55f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:39.066374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bd4ea01e-dcf2-4d96-a6ee-01500413d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:39.093169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ea01e-dcf2-4d96-a6ee-01500413d55f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:39.102126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3f122-431b-4b0e-b0e9-b2399734fca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:39.118524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f122-431b-4b0e-b0e9-b2399734fca5 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:39.118524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f122-431b-4b0e-b0e9-b2399734fca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:39.118524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3f122-431b-4b0e-b0e9-b2399734fca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:39.131995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3f122-431b-4b0e-b0e9-b2399734fca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:39.135861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3f122-431b-4b0e-b0e9-b2399734fca5 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:39.158308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 828/1662] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:39.240024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:39.241712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:39.399834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2a3cc-f3b6-4022-927a-eca4032a84c8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:39.400390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2a3cc-f3b6-4022-927a-eca4032a84c8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:39.400824 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2a3cc-f3b6-4022-927a-eca4032a84c8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:39.402873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 829/1663] 10.222.0.11 () {54 vars in 960 bytes} [Thu Nov 11 16:33:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:33:39.414024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:39.414562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:39.415436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:39.468901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c254859-890f-4bb3-8aa6-018e3a079b1a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:39.472899 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] MFA Rules not processed for user `c8a0c26778994b0c93541400cde47bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:39.476229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:39.497031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:39.500663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:39.500948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:39.501230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] PATH_INFO: `/v3/users/225b7f2ced804153841eb30dc6e99161` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:39.502980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225b7f2ced804153841eb30dc6e99161)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:39.504937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:39.664293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 830/1664] 10.222.0.11 () {58 vars in 1057 bytes} [Thu Nov 11 16:33:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:33:39.665513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:39.667342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:39.689411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4614eb5-d1e3-425f-a3ef-b2e3584affa3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:39.699140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:39.699964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:39.700485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:39.701133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] PATH_INFO: `/v3/projects/1107a60b87bb4d40be50d0008360fb81` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:39.702750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1107a60b87bb4d40be50d0008360fb81)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:39.704178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:33:39.704178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 11 16:33:39.704178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: Nov 11 16:33:39.705809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:39.793041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225b7f2ced804153841eb30dc6e99161'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.814887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225b7f2ced804153841eb30dc6e99161'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.818121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225b7f2ced804153841eb30dc6e99161'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.818835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225b7f2ced804153841eb30dc6e99161'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.837571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1107a60b87bb4d40be50d0008360fb81', 'request_id': 'req-90c04db5-9730-4078-b8da-52ccfc4530cd'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.841310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-45d5d9f6-26c9-4234-ba80-49b2bbe7c167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225b7f2ced804153841eb30dc6e99161'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.847144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1107a60b87bb4d40be50d0008360fb81', 'request_id': 'req-90c04db5-9730-4078-b8da-52ccfc4530cd'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.935694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1107a60b87bb4d40be50d0008360fb81', 'request_id': 'req-90c04db5-9730-4078-b8da-52ccfc4530cd'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.957185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] The token cache is being invalidate because project 1107a60b87bb4d40be50d0008360fb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:39.957671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.958554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:39.960766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 831/1665] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:39 2021] DELETE /identity/v3/projects/1107a60b87bb4d40be50d0008360fb81 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:39.961701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:39.966428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:40.038019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 835/1666] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:39 2021] DELETE /identity/v3/users/225b7f2ced804153841eb30dc6e99161 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:40.041358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fcd4-1cea-4fba-a792-662975438cb3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.042046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fcd4-1cea-4fba-a792-662975438cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.042668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fcd4-1cea-4fba-a792-662975438cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.055378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c04db5-9730-4078-b8da-52ccfc4530cd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:40.080504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a777fcd4-1cea-4fba-a792-662975438cb3 None None] MFA Rules not processed for user `5d4e9612e31d4c50a66daefaa2669021`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:40.082122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a777fcd4-1cea-4fba-a792-662975438cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:40.175028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be5e34-b282-42d3-a284-4fb3172f08b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a0c26778994b0c93541400cde47bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:40.182064 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5e34-b282-42d3-a284-4fb3172f08b1 service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.182638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5e34-b282-42d3-a284-4fb3172f08b1 service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.183235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be5e34-b282-42d3-a284-4fb3172f08b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.187218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c8be5e34-b282-42d3-a284-4fb3172f08b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:40.217109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be5e34-b282-42d3-a284-4fb3172f08b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:40.219086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be5e34-b282-42d3-a284-4fb3172f08b1 service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:40.242388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 832/1667] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:40.243932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcf477-548e-4ca6-9927-4af5564c90eb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.244223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcf477-548e-4ca6-9927-4af5564c90eb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.244498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcf477-548e-4ca6-9927-4af5564c90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.252425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 836/1668] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:40 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:40.253820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741f56-94ea-4576-97db-169b0280eb67 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.254113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741f56-94ea-4576-97db-169b0280eb67 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.254418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741f56-94ea-4576-97db-169b0280eb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.274026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-afbcf477-548e-4ca6-9927-4af5564c90eb None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:40.275330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-afbcf477-548e-4ca6-9927-4af5564c90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:40.313399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-80741f56-94ea-4576-97db-169b0280eb67 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:40.315259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-80741f56-94ea-4576-97db-169b0280eb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:40.421205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 833/1669] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:40.428477 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.428768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.429047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.457677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 837/1670] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:40.462153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:40.463418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:40.483117 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 834/1671] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:33:40.492838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741f56-94ea-4576-97db-169b0280eb67 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:40.513871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741f56-94ea-4576-97db-169b0280eb67 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:40.530610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:40.531443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.531719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.532009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.532779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:40.533089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:40.537076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:40.538888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:40.547635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:40.593217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 838/1672] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:40.594126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:40.641476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9b24f-11c8-49f0-aade-2407352e2727 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:40.679500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:40.684710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.688421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.690914 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.691672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:40.709452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:40.769442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534ebcc-fc9c-434d-9c0a-a83cc133d9b7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:40.780328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:40.783083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:40.783727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:40.784273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:40.809296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:40.832815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:40.852564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 839/1673] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:40 2021] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:40.861114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:40.889228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 835/1674] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:33:41.000548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a4e52-4b5c-4a5c-bbfd-0752850fb4d7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:41.014760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:41.015526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:41.016734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:41.017474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:41.018600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:41.021322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:41.135397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 840/1675] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:40 2021] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:41.139956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:41.154445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d0d5a-78a6-488d-ac3f-5c187301dfa0 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:41.174495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:41.175599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:41.175992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:41.176956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:41.178135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:41.180250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:41.202754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 836/1676] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:41 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:41.206965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:41.224534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a081c1c-7d76-46ae-873c-305e3af46779 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:41.229691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aec10-0f28-416d-a589-af1d0fccc43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:41.230410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aec10-0f28-416d-a589-af1d0fccc43a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:41.230695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aec10-0f28-416d-a589-af1d0fccc43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:41.230968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aec10-0f28-416d-a589-af1d0fccc43a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:41.237162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aec10-0f28-416d-a589-af1d0fccc43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:41.238988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aec10-0f28-416d-a589-af1d0fccc43a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:41.264863 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 841/1677] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:41 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:33:41.271559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:41.288754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c237d3-480e-42cc-b417-b9caf7ee1a6c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:41.308641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:41.309554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:41.312687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:41.313007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] PATH_INFO: `/v3/projects/417cd2890887443b8dfbfd533d802e4f/users/372b4b0012674384a8495bd1a160277a/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:41.350601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417cd2890887443b8dfbfd533d802e4f, user_id=372b4b0012674384a8495bd1a160277a, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:41.353546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:41.483218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 837/1678] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:41 2021] PUT /identity/v3/projects/417cd2890887443b8dfbfd533d802e4f/users/372b4b0012674384a8495bd1a160277a/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:41.495095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343731bc-ad21-42e2-b11f-3bb1eaae54c1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:41.498344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343731bc-ad21-42e2-b11f-3bb1eaae54c1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:41.498344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343731bc-ad21-42e2-b11f-3bb1eaae54c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:41.530974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-343731bc-ad21-42e2-b11f-3bb1eaae54c1 None None] MFA Rules not processed for user `372b4b0012674384a8495bd1a160277a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:41.532689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-343731bc-ad21-42e2-b11f-3bb1eaae54c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:41.643087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:41.654510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 842/1679] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:41 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:41.826282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4db53c-c0ca-49f6-8e9a-322bf70d0b09 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:41.846035 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:41.847387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:41.849303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:41.851016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:41.854335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:41.863208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:42.169490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 838/1680] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:41 2021] POST /identity/v3/projects => generated 373 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:42.171324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343731bc-ad21-42e2-b11f-3bb1eaae54c1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:42.171324 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343731bc-ad21-42e2-b11f-3bb1eaae54c1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:42.306963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:42.307650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:42.308079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:42.308525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:42.309461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:42.321172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:42.440714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 843/1681] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:42 2021] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:42.443158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:42.459023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59e121-26fa-4731-b0bc-d78467cfae07 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:42.471238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:42.474796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:42.475305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:42.475746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:42.477847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:42.481317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:42.522168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 839/1682] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:33:42.523599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:42.559204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810061c5-94e5-4c8f-ac79-7038a7788e98 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:42.581423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:42.584752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:42.586940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:42.587348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] PATH_INFO: `/v3/projects/ddcd802ce1b343f48b588e55eaecc1e9/users/440c80491d99430f93cd89fbb3b4781b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:42.646236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcd802ce1b343f48b588e55eaecc1e9, user_id=440c80491d99430f93cd89fbb3b4781b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:42.652558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:42.836527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 844/1683] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:42 2021] PUT /identity/v3/projects/ddcd802ce1b343f48b588e55eaecc1e9/users/440c80491d99430f93cd89fbb3b4781b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:42.842282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:42.866735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d24bc8-174e-4f50-867d-8734d739a248 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:42.921485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:42.924399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:43.074556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:43.075088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:43.075427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:43.077961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:43.079773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:43.082738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:43.114623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 840/1684] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:33:43.115615 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:43.147974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00171e-9713-48b0-9e88-c139c97d4236 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:43.155464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85febe9-f494-486b-8111-5e9f40073a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:43.157495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85febe9-f494-486b-8111-5e9f40073a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:43.158517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f80ff-fd78-4522-b27d-a91334c18617 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:43.159237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85febe9-f494-486b-8111-5e9f40073a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:43.159619 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85febe9-f494-486b-8111-5e9f40073a41 admin admin] PATH_INFO: `/v3/projects/ddcd802ce1b343f48b588e55eaecc1e9/users/440c80491d99430f93cd89fbb3b4781b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:43.163576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85febe9-f494-486b-8111-5e9f40073a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcd802ce1b343f48b588e55eaecc1e9, user_id=440c80491d99430f93cd89fbb3b4781b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:43.171877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85febe9-f494-486b-8111-5e9f40073a41 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:43.180200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:43.181689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:43.182140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:43.182599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] PATH_INFO: `/v3/projects/9c7bfad662b4489c948dd2d07a15dce3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:43.184012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7bfad662b4489c948dd2d07a15dce3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:43.205799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:43.224870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 841/1685] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:43 2021] PUT /identity/v3/projects/ddcd802ce1b343f48b588e55eaecc1e9/users/440c80491d99430f93cd89fbb3b4781b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:43.273082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:43.273082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:43.273082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:43.348503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] MFA Rules not processed for user `440c80491d99430f93cd89fbb3b4781b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:43.351783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:43.407085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7bfad662b4489c948dd2d07a15dce3', 'request_id': 'req-79e51c97-354c-4e7d-883d-0ae7980251b9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.423561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7bfad662b4489c948dd2d07a15dce3', 'request_id': 'req-79e51c97-354c-4e7d-883d-0ae7980251b9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.505914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 842/1686] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:43 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:43.509876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7bfad662b4489c948dd2d07a15dce3', 'request_id': 'req-79e51c97-354c-4e7d-883d-0ae7980251b9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.520554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:43.530116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:43.538942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] The token cache is being invalidate because project 9c7bfad662b4489c948dd2d07a15dce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:43.539238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.539934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.541806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 845/1687] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:42 2021] DELETE /identity/v3/projects/9c7bfad662b4489c948dd2d07a15dce3 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:33:43.554795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:43.561182 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:43.647181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98128f94-21c5-4e19-b11a-8aacb87d887c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:43.709061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e51c97-354c-4e7d-883d-0ae7980251b9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:43.723974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:43.724874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:43.725160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:43.725435 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] PATH_INFO: `/v3/users/a2c2057fe24049ebb5d99bba11112a53` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:43.727020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c2057fe24049ebb5d99bba11112a53)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:43.729048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:43.741765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:43.741765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:43.741765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:43.741765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:43.746891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:43.862211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:43.863735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:43.876071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 843/1688] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:43 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:43.876927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:43.878283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:43.891573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447cad3-50ed-455c-830f-84170074c01f service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:43.896695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:43.897594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:43.897880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:43.898160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] PATH_INFO: `/v3/users/16e979f73768419eb33322efdac16188` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:43.899452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e979f73768419eb33322efdac16188)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:43.901401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:43.938639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c2057fe24049ebb5d99bba11112a53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.958152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c2057fe24049ebb5d99bba11112a53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.963881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c2057fe24049ebb5d99bba11112a53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.963881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c2057fe24049ebb5d99bba11112a53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:43.970553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c2057fe24049ebb5d99bba11112a53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:44.095387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 846/1689] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:43 2021] DELETE /identity/v3/users/a2c2057fe24049ebb5d99bba11112a53 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:44.227757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e979f73768419eb33322efdac16188'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:44.229361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e979f73768419eb33322efdac16188'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:44.295789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e979f73768419eb33322efdac16188'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:44.298361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e979f73768419eb33322efdac16188'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:44.375632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e979f73768419eb33322efdac16188'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:44.419745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 844/1690] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:43 2021] DELETE /identity/v3/users/16e979f73768419eb33322efdac16188 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:44.864668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:44.867846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:44.920804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:44.922995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:45.023723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77328-a93a-47f0-a446-c713707f2ece admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:45.032626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799760f-4a32-4507-b909-d04d15b8b9e0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:45.033418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:45.037548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.038029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.038690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] PATH_INFO: `/v3/users/372b4b0012674384a8495bd1a160277a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:45.039368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:45.040326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.040787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.041135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] PATH_INFO: `/v3/projects/2eb28cf941d546bebd002b1c0888fec7` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:45.042056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=372b4b0012674384a8495bd1a160277a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:45.043528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb28cf941d546bebd002b1c0888fec7)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:45.046223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:45.053702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:45.307275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb28cf941d546bebd002b1c0888fec7', 'request_id': 'req-a0acce80-5346-483d-9c18-4e015ea3d12b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.316995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb28cf941d546bebd002b1c0888fec7', 'request_id': 'req-a0acce80-5346-483d-9c18-4e015ea3d12b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.322727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372b4b0012674384a8495bd1a160277a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.338859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372b4b0012674384a8495bd1a160277a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.339633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372b4b0012674384a8495bd1a160277a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.340441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372b4b0012674384a8495bd1a160277a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.348771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372b4b0012674384a8495bd1a160277a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.389741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb28cf941d546bebd002b1c0888fec7', 'request_id': 'req-a0acce80-5346-483d-9c18-4e015ea3d12b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.404110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] The token cache is being invalidate because project 2eb28cf941d546bebd002b1c0888fec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:45.404931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.405224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.407061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 845/1691] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:44 2021] DELETE /identity/v3/projects/2eb28cf941d546bebd002b1c0888fec7 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:45.408922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:45.410403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:45.477102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acce80-5346-483d-9c18-4e015ea3d12b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:45.483049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:45.484562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.484852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.485648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] PATH_INFO: `/v3/projects/1c512e929216481c811cffb158fc6a47` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:45.486410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 847/1692] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:44 2021] DELETE /identity/v3/users/372b4b0012674384a8495bd1a160277a => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:45.486621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c512e929216481c811cffb158fc6a47)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:45.487655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:45.488528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:45.489347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:45.560235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5f2a-d7f1-4486-a146-90728d88e8e8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:45.564921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:45.565793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.566073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.566404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] PATH_INFO: `/v3/users/5d4e9612e31d4c50a66daefaa2669021` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:45.567763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4e9612e31d4c50a66daefaa2669021)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:45.569692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:45.607527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c512e929216481c811cffb158fc6a47', 'request_id': 'req-5d301761-6b71-4b61-aa31-a84aa8f022c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.609203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c512e929216481c811cffb158fc6a47', 'request_id': 'req-5d301761-6b71-4b61-aa31-a84aa8f022c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.740898 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c512e929216481c811cffb158fc6a47', 'request_id': 'req-5d301761-6b71-4b61-aa31-a84aa8f022c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.753667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] The token cache is being invalidate because project 1c512e929216481c811cffb158fc6a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:45.754246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.764428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5d301761-6b71-4b61-aa31-a84aa8f022c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.770214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 846/1693] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:45 2021] DELETE /identity/v3/projects/1c512e929216481c811cffb158fc6a47 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:45.771533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940a92-fb91-490c-bb97-6bd9916ca2d5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.771826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940a92-fb91-490c-bb97-6bd9916ca2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.772115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d940a92-fb91-490c-bb97-6bd9916ca2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:45.788797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4e9612e31d4c50a66daefaa2669021'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.803787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6d940a92-fb91-490c-bb97-6bd9916ca2d5 None None] MFA Rules not processed for user `c0e12bd4237643e99e03e73f6c5c69f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:45.808171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4e9612e31d4c50a66daefaa2669021'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.808171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4e9612e31d4c50a66daefaa2669021'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.808438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6d940a92-fb91-490c-bb97-6bd9916ca2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:45.808531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4e9612e31d4c50a66daefaa2669021'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.812820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5111a1f9-204c-4b68-924d-2f891c333166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4e9612e31d4c50a66daefaa2669021'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:45.869844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 847/1694] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:45 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:45.871433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468fbc-9739-4e67-b586-ff4690b4eb74 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.871717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468fbc-9739-4e67-b586-ff4690b4eb74 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.871995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468fbc-9739-4e67-b586-ff4690b4eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:45.884115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 848/1695] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:45 2021] DELETE /identity/v3/users/5d4e9612e31d4c50a66daefaa2669021 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:45.885468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.888519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.888519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:45.896512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-80468fbc-9739-4e67-b586-ff4690b4eb74 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:45.897104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-80468fbc-9739-4e67-b586-ff4690b4eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:45.925313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] MFA Rules not processed for user `4514d443d8ce47308af5a772b5c6de57`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:45.926599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:45.974722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 848/1696] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:45.976249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:45.976546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:45.976826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.003206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:46.003821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.021395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 849/1697] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:46.021395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:46.021395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.083639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 849/1698] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:45 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:46.084858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:46.086954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.174851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccb2a0-e2a3-4483-827f-3bf5172953f3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:46.189429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:46.190100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.190411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.190687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.222660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f0338-1375-4750-af2e-4aafdfb3e756 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:46.248651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c232-0c71-4657-a158-3f165adfe7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:46.249362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c232-0c71-4657-a158-3f165adfe7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.255476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c232-0c71-4657-a158-3f165adfe7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.255476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c232-0c71-4657-a158-3f165adfe7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.277200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c232-0c71-4657-a158-3f165adfe7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:46.281524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c232-0c71-4657-a158-3f165adfe7e7 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:46.308100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 850/1699] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:46.311459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09168d-87c2-48dc-a663-7dfd954c3d19 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.311902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09168d-87c2-48dc-a663-7dfd954c3d19 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.313013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09168d-87c2-48dc-a663-7dfd954c3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.355696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5a09168d-87c2-48dc-a663-7dfd954c3d19 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:46.360139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5a09168d-87c2-48dc-a663-7dfd954c3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.367434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:46.371296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:46.397123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 851/1701] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:46.399243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b61b-d558-444c-b42e-6dbd13714c9c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.399919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b61b-d558-444c-b42e-6dbd13714c9c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.399919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b61b-d558-444c-b42e-6dbd13714c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.405931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 850/1701] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:46 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:46.409936 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:46.418934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.448870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7749b61b-d558-444c-b42e-6dbd13714c9c None None] MFA Rules not processed for user `4514d443d8ce47308af5a772b5c6de57`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:46.449077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349a501-0e23-4c79-af88-705dc0d9bbee service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:46.451552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7749b61b-d558-444c-b42e-6dbd13714c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.454550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:46.455427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.455707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.455988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] PATH_INFO: `/v3/projects/c132430eaa744505817c92df3659da8e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.457561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c132430eaa744505817c92df3659da8e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:46.459767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:46.475799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 852/1702] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:46 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:46.484444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b61b-d558-444c-b42e-6dbd13714c9c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:46.503808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b61b-d558-444c-b42e-6dbd13714c9c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:46.509170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:46.510517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.511013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.511464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.512462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:46.512990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:46.515057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:46.530498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 853/1703] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:46.534290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:46.553065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edbce7-2a1f-4d62-b867-b15252e9574a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:46.559989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:46.561005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.562514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.563719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.563719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:46.568904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:46.650067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c132430eaa744505817c92df3659da8e', 'request_id': 'req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:46.658013 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c132430eaa744505817c92df3659da8e', 'request_id': 'req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:46.708988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 854/1704] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:46 2021] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:33:46.708988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:46.710758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.752426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c132430eaa744505817c92df3659da8e', 'request_id': 'req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:46.770794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] The token cache is being invalidate because project c132430eaa744505817c92df3659da8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:46.771135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:46.774713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:46.782616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 851/1705] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:46 2021] DELETE /identity/v3/projects/c132430eaa744505817c92df3659da8e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:46.782616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:46.784148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.865760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97302844-8d18-44a6-a06f-ccdfd11e15d4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:46.877994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ad00c-e407-40f9-9872-73c583545b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:46.878933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad00c-e407-40f9-9872-73c583545b3f service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:46.879265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad00c-e407-40f9-9872-73c583545b3f service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:46.879868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad00c-e407-40f9-9872-73c583545b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:46.882003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-215ad00c-e407-40f9-9872-73c583545b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:46.917282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573f4ad-8c4b-45e6-bc7b-f6f4e171eda5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:46.989302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad00c-e407-40f9-9872-73c583545b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:46.991146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad00c-e407-40f9-9872-73c583545b3f service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:47.002325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 855/1706] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:46 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:47.004167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c6ab-e39f-4584-9c9e-a10568aba161 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.004648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c6ab-e39f-4584-9c9e-a10568aba161 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.005158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c6ab-e39f-4584-9c9e-a10568aba161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.027353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b238c6ab-e39f-4584-9c9e-a10568aba161 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:47.030635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b238c6ab-e39f-4584-9c9e-a10568aba161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:47.040109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:47.040802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.041111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.045840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.045951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 856/1707] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:47.046031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:47.047560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:47.062144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.077724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.084950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.112720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:47.112720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:47.143705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 857/1708] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:47.145278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:47.149495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:47.164985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c80b5-f39d-4cf9-a965-3170e5562ac6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:47.169816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:47.175710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.175710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.175710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] PATH_INFO: `/v3/projects/417cd2890887443b8dfbfd533d802e4f` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.175710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=417cd2890887443b8dfbfd533d802e4f)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:47.175710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:47.206453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 852/1709] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:46 2021] POST /identity/v3/users => generated 294 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:47.207297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:47.245211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff273-dc2d-40a8-acc8-93c65561740a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:47.263989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:47.264684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.264970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.267683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.272612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:47.273969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:47.276843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:47.316896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417cd2890887443b8dfbfd533d802e4f', 'request_id': 'req-58e0a96c-f107-4716-807b-ee50684d95ba'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:47.324622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 853/1710] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:47.324622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:47.330860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417cd2890887443b8dfbfd533d802e4f', 'request_id': 'req-58e0a96c-f107-4716-807b-ee50684d95ba'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:47.347560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c8b0-f9d7-4866-b35d-fdbc759b012b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:47.413055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417cd2890887443b8dfbfd533d802e4f', 'request_id': 'req-58e0a96c-f107-4716-807b-ee50684d95ba'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:47.432667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] The token cache is being invalidate because project 417cd2890887443b8dfbfd533d802e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:47.432667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:47.437495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:47.445161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 858/1711] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:47 2021] DELETE /identity/v3/projects/417cd2890887443b8dfbfd533d802e4f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:47.447295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:47.451021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:47.510336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:47.511367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.511727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.512120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.513547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:47.518784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:47.560947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 854/1712] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:47.568454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:47.574807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:47.605759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d0a64-dc97-4226-93bb-07b1468b9ed6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:47.613962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:47.614931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.615211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.615494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] PATH_INFO: `/v3/users/440c80491d99430f93cd89fbb3b4781b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.618013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0a96c-f107-4716-807b-ee50684d95ba admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:47.619857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440c80491d99430f93cd89fbb3b4781b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:47.623583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:47.629299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:47.637653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:47.637653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:47.637653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:47.637653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:47.637653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:47.833219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 859/1713] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:47 2021] POST /identity/v3/projects => generated 381 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:47.834128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:47.851129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:47.976453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440c80491d99430f93cd89fbb3b4781b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:47.977671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440c80491d99430f93cd89fbb3b4781b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:48.006124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def31e5-74d1-42ef-90af-c1f220ea032c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:48.030857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:48.033133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.033360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440c80491d99430f93cd89fbb3b4781b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:48.034539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.035538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.037468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440c80491d99430f93cd89fbb3b4781b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:48.039124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:48.041653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:48.080708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 860/1714] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:48.081845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:48.085520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:48.105196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9c10-86ff-4aa5-8d97-c600123c210b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:48.112263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:48.113157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.114329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.114967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.116032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:48.118496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:48.152626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440c80491d99430f93cd89fbb3b4781b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:48.168379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 855/1715] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:47 2021] DELETE /identity/v3/users/440c80491d99430f93cd89fbb3b4781b => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:48.170093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:48.171888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:48.270625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 861/1716] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:48 2021] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:48.272856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:48.307994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed6e1-47f8-4730-91d6-48114dea408d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:48.443922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:48.444671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.444964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.445308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.446140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:48.448224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:48.467307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 862/1717] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:48.470606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c7dcb-e107-446a-87eb-5133eaf76787 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:48.482347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:48.487657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc46f-76e0-4f78-a1ce-e0153a35c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:48.488781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc46f-76e0-4f78-a1ce-e0153a35c534 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.489155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc46f-76e0-4f78-a1ce-e0153a35c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.489434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc46f-76e0-4f78-a1ce-e0153a35c534 admin admin] PATH_INFO: `/v3/projects/efed960bf2e84eebb31e01198a437256/users/3f212531f9d2461e8f39566161950294/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.525787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9095aa3-13fe-42e8-b162-a0ccf9087d2d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:48.541750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:48.542694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.544711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.545281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.549391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:48.552832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:48.567750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc46f-76e0-4f78-a1ce-e0153a35c534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efed960bf2e84eebb31e01198a437256, user_id=3f212531f9d2461e8f39566161950294, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:48.586242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc46f-76e0-4f78-a1ce-e0153a35c534 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:48.626868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 863/1718] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:48.627917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:48.651344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b98a7-303d-4d84-8a4c-e8b622bbb03e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:48.657591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee23129-0032-4b0a-9502-cb30ebf9264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:48.658846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee23129-0032-4b0a-9502-cb30ebf9264d admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.659578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee23129-0032-4b0a-9502-cb30ebf9264d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.660102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee23129-0032-4b0a-9502-cb30ebf9264d admin admin] PATH_INFO: `/v3/projects/d09a340c791542fa855da0230d54aad1/users/0e6064354ba14360a26b2fe2d015e0e6/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.685522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee23129-0032-4b0a-9502-cb30ebf9264d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09a340c791542fa855da0230d54aad1, user_id=0e6064354ba14360a26b2fe2d015e0e6, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:48.688441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee23129-0032-4b0a-9502-cb30ebf9264d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:48.727075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 856/1719] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:48 2021] PUT /identity/v3/projects/efed960bf2e84eebb31e01198a437256/users/3f212531f9d2461e8f39566161950294/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:48.728502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdffd2-ea61-4589-bd99-ce769f5ef15c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.728906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdffd2-ea61-4589-bd99-ce769f5ef15c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.732502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdffd2-ea61-4589-bd99-ce769f5ef15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.780149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1dfdffd2-ea61-4589-bd99-ce769f5ef15c None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:48.786537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1dfdffd2-ea61-4589-bd99-ce769f5ef15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:48.836882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 864/1720] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:48 2021] PUT /identity/v3/projects/d09a340c791542fa855da0230d54aad1/users/0e6064354ba14360a26b2fe2d015e0e6/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:48.839766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7332174-5484-41d9-8e6c-680e4ff8572e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.840746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7332174-5484-41d9-8e6c-680e4ff8572e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.844264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7332174-5484-41d9-8e6c-680e4ff8572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.954547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 857/1721] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:33:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:48.956156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074d890-a44b-41dc-a99c-045aae5b08f5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:48.957851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074d890-a44b-41dc-a99c-045aae5b08f5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:48.958476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074d890-a44b-41dc-a99c-045aae5b08f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:48.961700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f7332174-5484-41d9-8e6c-680e4ff8572e None None] MFA Rules not processed for user `3f212531f9d2461e8f39566161950294`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:48.968557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f7332174-5484-41d9-8e6c-680e4ff8572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:49.052076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5074d890-a44b-41dc-a99c-045aae5b08f5 None None] MFA Rules not processed for user `0e6064354ba14360a26b2fe2d015e0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:49.053697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5074d890-a44b-41dc-a99c-045aae5b08f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:49.133711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 865/1722] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:48 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:49.133711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368df34-12a2-4680-8edf-0e480ccfb874 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:49.133711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368df34-12a2-4680-8edf-0e480ccfb874 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:49.133711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368df34-12a2-4680-8edf-0e480ccfb874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:49.169929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d368df34-12a2-4680-8edf-0e480ccfb874 None None] MFA Rules not processed for user `4514d443d8ce47308af5a772b5c6de57`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:49.171496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d368df34-12a2-4680-8edf-0e480ccfb874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:49.271530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 858/1723] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:49.276027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074d890-a44b-41dc-a99c-045aae5b08f5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:49.305757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 866/1724] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:49 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:49.306725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368df34-12a2-4680-8edf-0e480ccfb874 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:49.485744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368df34-12a2-4680-8edf-0e480ccfb874 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:49.493691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:49.494495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:49.494787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:49.495067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:49.495797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:49.497763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:49.525008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074d890-a44b-41dc-a99c-045aae5b08f5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:49.537190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:49.538153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:49.538652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:49.539111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:49.540007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:49.542108 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:49.656383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 867/1726] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:49 2021] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:49.656556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 859/1726] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:49 2021] POST /identity/v3/projects => generated 385 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:49.656973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:49.659739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:49.659991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:49.815737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d078b8a-8eb2-41d7-b11c-62322046f78e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:49.840146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d89d79-b9b9-4183-8f3d-b89ac3cd5392 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:49.855753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:49.856678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:49.856908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:49.857399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:49.964723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:49.965584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:49.966555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:49.967341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:49.968242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:49.975986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:49.985670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:49.989083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.011617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 868/1727] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:33:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:33:50.012372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.039184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32761-7638-49c7-8559-6fb4b3a8e69e service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.062904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.063638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.063934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.067151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.067151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.072522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.107607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 860/1728] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:49 2021] POST /identity/v3/users => generated 299 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:50.108862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.153038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8394279-c49d-4fb3-982b-ce0e4e514709 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.182132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 869/1729] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:50 2021] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:50.183454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.184202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.185645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.186243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.186745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.187849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.189661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.211072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78115985-e9da-45c7-841d-62277dd885cd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.230006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 861/1730] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:50.233834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.235045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.238307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.238307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.238307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.238307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.238645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.260647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807702e-46c2-4647-ac2a-4de3a334d85a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.276570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.277716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.278158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.278872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] PATH_INFO: `/v3/projects/37723fe60dd245949a667cbe62f6288b/users/505c8a260f1b49eba58bfd7d3a5c43c8/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.288461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 870/1731] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:50.294369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.328960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37723fe60dd245949a667cbe62f6288b, user_id=505c8a260f1b49eba58bfd7d3a5c43c8, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.332099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.345911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e7783-9e39-4eb0-a2de-eda2c551e5c1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.367983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.368897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.369177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.369525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] PATH_INFO: `/v3/projects/e8a00a6f8d924eefb475e52141e90d28/users/25c995c3e8114847887f1e4e35e99424/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.433916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a00a6f8d924eefb475e52141e90d28, user_id=25c995c3e8114847887f1e4e35e99424, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.437201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.461153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 862/1732] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:50 2021] PUT /identity/v3/projects/37723fe60dd245949a667cbe62f6288b/users/505c8a260f1b49eba58bfd7d3a5c43c8/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:50.465685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.558026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 871/1733] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:50 2021] PUT /identity/v3/projects/e8a00a6f8d924eefb475e52141e90d28/users/25c995c3e8114847887f1e4e35e99424/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:50.562671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.674479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c0a2-fcf8-4f71-b2ab-44331edbccf7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.781341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594d31b-e8df-4785-9a83-749e5bc113b6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.793531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.794820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.795161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.795531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.796302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.798007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.823655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 872/1734] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:33:50.824411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.830135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:50.833800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.834678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.834984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.835326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.836199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.839295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.853088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48241c-80a7-4452-ac82-d4977644bf4a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.866909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 863/1735] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:33:50.868392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:50.874691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.877181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.877181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.877181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] PATH_INFO: `/v3/projects/ddcd802ce1b343f48b588e55eaecc1e9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.878223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddcd802ce1b343f48b588e55eaecc1e9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.880369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:50.898868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322d1a-06e5-4526-90cc-e12a1f8161de admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:50.914858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:50.931170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:50.931457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:50.931734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] PATH_INFO: `/v3/projects/e8a00a6f8d924eefb475e52141e90d28/users/25c995c3e8114847887f1e4e35e99424/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:50.943773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a00a6f8d924eefb475e52141e90d28, user_id=25c995c3e8114847887f1e4e35e99424, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:50.955560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:51.030073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 864/1736] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:50 2021] PUT /identity/v3/projects/e8a00a6f8d924eefb475e52141e90d28/users/25c995c3e8114847887f1e4e35e99424/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:51.053112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:51.163833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddcd802ce1b343f48b588e55eaecc1e9', 'request_id': 'req-22f17cfa-e4a8-4d54-80ac-2edddf12898e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:51.220057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddcd802ce1b343f48b588e55eaecc1e9', 'request_id': 'req-22f17cfa-e4a8-4d54-80ac-2edddf12898e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:51.324187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068f431-490b-4335-b911-ba6a3cb86fd0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:51.336506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddcd802ce1b343f48b588e55eaecc1e9', 'request_id': 'req-22f17cfa-e4a8-4d54-80ac-2edddf12898e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:51.365879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] The token cache is being invalidate because project ddcd802ce1b343f48b588e55eaecc1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:51.366223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:51.375367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-22f17cfa-e4a8-4d54-80ac-2edddf12898e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:51.385602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 873/1737] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:50 2021] DELETE /identity/v3/projects/ddcd802ce1b343f48b588e55eaecc1e9 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:51.391098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e3a8-5fd4-48fa-93a0-799568a90147 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:51.391389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e3a8-5fd4-48fa-93a0-799568a90147 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:51.394988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e3a8-5fd4-48fa-93a0-799568a90147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:51.526150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcb11c-faf4-4cde-8ca0-561af7e80fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:51.527622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcb11c-faf4-4cde-8ca0-561af7e80fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:51.528068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcb11c-faf4-4cde-8ca0-561af7e80fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:51.528517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcb11c-faf4-4cde-8ca0-561af7e80fc1 admin admin] PATH_INFO: `/v3/projects/37723fe60dd245949a667cbe62f6288b/users/505c8a260f1b49eba58bfd7d3a5c43c8/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:51.531308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcb11c-faf4-4cde-8ca0-561af7e80fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37723fe60dd245949a667cbe62f6288b, user_id=505c8a260f1b49eba58bfd7d3a5c43c8, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:51.534136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcb11c-faf4-4cde-8ca0-561af7e80fc1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:51.548249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 865/1738] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:51 2021] PUT /identity/v3/projects/37723fe60dd245949a667cbe62f6288b/users/505c8a260f1b49eba58bfd7d3a5c43c8/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:51.560187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637a50-0806-47a5-b334-8cdc440abacc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:51.560738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637a50-0806-47a5-b334-8cdc440abacc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:51.561185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637a50-0806-47a5-b334-8cdc440abacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:51.567443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3b31e3a8-5fd4-48fa-93a0-799568a90147 None None] MFA Rules not processed for user `25c995c3e8114847887f1e4e35e99424`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:51.571575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3b31e3a8-5fd4-48fa-93a0-799568a90147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:51.612229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b5637a50-0806-47a5-b334-8cdc440abacc None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:51.613864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b5637a50-0806-47a5-b334-8cdc440abacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:51.791578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 866/1739] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:51.795940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 874/1740] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:51 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:51.797153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:51.797526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:51.797877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:51.808749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280367-5a86-41b1-8d77-71237056e88c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:51.809165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280367-5a86-41b1-8d77-71237056e88c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:51.810162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280367-5a86-41b1-8d77-71237056e88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:51.830631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] MFA Rules not processed for user `25123d6cb4fc417899321ecdb3c76b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:51.834172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:51.900608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-97280367-5a86-41b1-8d77-71237056e88c None None] MFA Rules not processed for user `505c8a260f1b49eba58bfd7d3a5c43c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:51.901867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-97280367-5a86-41b1-8d77-71237056e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:51.991670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 875/1741] 10.222.0.70 () {58 vars in 1015 bytes} [Thu Nov 11 16:33:51 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:51.993057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:51.998235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:52.017333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 867/1742] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:51 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:52.023660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:52.024099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:52.024510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:52.060884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:52.062748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:52.067195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11946df-6cf3-48ba-950e-371ae65df8c7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:52.080771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:52.086690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 868/1743] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:52.088041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:52.088273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:52.088773 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:52.089244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] PATH_INFO: `/v3/users/0e6064354ba14360a26b2fe2d015e0e6` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:52.092427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:52.094393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6064354ba14360a26b2fe2d015e0e6)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:52.096640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:52.137161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014df44-f302-4a89-81d9-f4cef60bf088 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:52.148467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:52.149368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:52.149865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:52.151479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:52.173851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:52.176171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:52.187697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 869/1744] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:52 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:52.188872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:52.190501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:52.350162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54374566-a1c5-4e7f-b44d-4b42b91629e3 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:52.352293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6064354ba14360a26b2fe2d015e0e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:52.389776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:52.389776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:52.392590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:52.392590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:52.398044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6064354ba14360a26b2fe2d015e0e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:52.398939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6064354ba14360a26b2fe2d015e0e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:52.399734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6064354ba14360a26b2fe2d015e0e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:52.421111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:52.421466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6064354ba14360a26b2fe2d015e0e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:52.422113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:52.484157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 870/1745] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:52 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:52.484157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:52.493731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813523de-5975-4154-bf90-2058e7418cb5 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:52.505902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:52.506640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:52.508536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:52.508536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:52.509731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:33:52.510101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:52.519357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:52.563396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 871/1746] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:33:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:33:52.569932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:52.576652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:52.615803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe406-b0c5-4bbc-976e-b1a0b1691ea8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:52.627930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aff943-6215-4b24-8003-8019331dc69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:52.628617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aff943-6215-4b24-8003-8019331dc69c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:52.628901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aff943-6215-4b24-8003-8019331dc69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:52.629177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aff943-6215-4b24-8003-8019331dc69c admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:52.629895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aff943-6215-4b24-8003-8019331dc69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:52.632695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aff943-6215-4b24-8003-8019331dc69c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:53.600982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 876/1747] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:51 2021] DELETE /identity/v3/users/0e6064354ba14360a26b2fe2d015e0e6 => generated 0 bytes in 1609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:53.612893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:53.612893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:53.675671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8a9e-ab2a-44a1-8b9b-26bd37f35efa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:53.680634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:53.681518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:53.681805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:53.682081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] PATH_INFO: `/v3/users/3f212531f9d2461e8f39566161950294` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:53.683336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f212531f9d2461e8f39566161950294)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:53.685974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:53.883588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 872/1748] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:52 2021] POST /identity/v3/projects => generated 365 bytes in 1314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:53.884974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:53.885267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:53.885548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:53.922148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:53.923550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:54.096368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f212531f9d2461e8f39566161950294'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:54.149984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f212531f9d2461e8f39566161950294'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:54.151918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f212531f9d2461e8f39566161950294'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:54.153757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f212531f9d2461e8f39566161950294'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:54.190100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a27fee5f-107d-4067-8cda-a835b2706632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f212531f9d2461e8f39566161950294'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:54.190814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 873/1749] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:54.195156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:54.210962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:54.270006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e0945-2ff1-4478-a60a-87431c7a6a8c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:54.285396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 877/1750] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:53 2021] DELETE /identity/v3/users/3f212531f9d2461e8f39566161950294 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:54.295333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59d27-ae59-44da-ba48-9e69263aa92d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.295550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59d27-ae59-44da-ba48-9e69263aa92d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.295726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59d27-ae59-44da-ba48-9e69263aa92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.297371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:54.298211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.298676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.299059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.299888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:54.302006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:54.357484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-75a59d27-ae59-44da-ba48-9e69263aa92d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:54.359954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-75a59d27-ae59-44da-ba48-9e69263aa92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:54.425655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 874/1751] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:54 2021] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:54.425655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:54.427565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:54.482979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 878/1752] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:54.484398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59d27-ae59-44da-ba48-9e69263aa92d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:54.499712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59d27-ae59-44da-ba48-9e69263aa92d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:54.506710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:54.507742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.508580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.509100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.510643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:54.513388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:54.527670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 879/1753] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:54 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:54.529297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:54.531455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:54.592713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4ce5d-7cd1-4b9d-9c66-9d9ac1ef9ee7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:54.632386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889fc9-9031-4d0b-b844-8b0a1bfd760b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:54.638535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:54.640009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.642921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.643894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.658637 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:54.660608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:54.675822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 880/1754] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:54.678430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:54.690365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ca17a-a2b9-43c7-b371-7006ea298d9a service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:54.695324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ca7c0-8d07-4765-b847-b1b84d247342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:54.696287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca7c0-8d07-4765-b847-b1b84d247342 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.696726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca7c0-8d07-4765-b847-b1b84d247342 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.697170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:54.698255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca7c0-8d07-4765-b847-b1b84d247342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.698748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.699643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.701592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.702880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:54.705638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:54.721995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 881/1755] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:54 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:54.726214 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:54.734638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca7c0-8d07-4765-b847-b1b84d247342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:54.738688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca7c0-8d07-4765-b847-b1b84d247342 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:54.744152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9329-1ab3-467e-afa4-85b40c063804 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:54.753597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:54.754002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.754651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.755154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] PATH_INFO: `/v3/projects/05734ababc0f43088adbe21968ac9557/users/8034af5beb8e4c56b2ee7826ffb4930d/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.770485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 875/1756] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:54.783219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05734ababc0f43088adbe21968ac9557, user_id=8034af5beb8e4c56b2ee7826ffb4930d, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:54.786961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:54.876008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 882/1757] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:54 2021] PUT /identity/v3/projects/05734ababc0f43088adbe21968ac9557/users/8034af5beb8e4c56b2ee7826ffb4930d/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:33:54.887822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9bbf-72c5-4aa3-9bed-542bfa0dba93 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:54.887822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9bbf-72c5-4aa3-9bed-542bfa0dba93 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:54.888247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9bbf-72c5-4aa3-9bed-542bfa0dba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:54.971322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fb1b9bbf-72c5-4aa3-9bed-542bfa0dba93 None None] MFA Rules not processed for user `8034af5beb8e4c56b2ee7826ffb4930d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:54.972575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fb1b9bbf-72c5-4aa3-9bed-542bfa0dba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:55.177702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 876/1758] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:54 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:55.179034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:55.332768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81541353-4060-48ce-9e11-bdcf8a9a7bc5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:55.340764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:55.342434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:55.343052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:55.343802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:55.345109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:55.347355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:55.381699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa2286-346d-4ec0-a348-024d3e1e1a51 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:55.381878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa2286-346d-4ec0-a348-024d3e1e1a51 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:55.382264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa2286-346d-4ec0-a348-024d3e1e1a51 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:55.385003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 877/1759] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:33:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:33:55.411985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:55.412238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:55.412610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:55.466536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:55.468171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:55.566423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 883/1760] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:33:55 2021] POST /identity/v3/projects => generated 365 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:55.576063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:55.706518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 878/1761] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:33:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:55.746921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:55.749277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:55.773938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edcc93-0b41-4da1-b024-ba655dc896f6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:55.892786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc67178-9efe-42af-a4cf-e9d03a99fac0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:55.922197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:55.922896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:55.923191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:55.923519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:55.924244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:55.935222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:55.997595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:55.998601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:56.000076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:56.000200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:56.025222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:56.026864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:56.054350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 879/1762] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:56.089795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 884/1763] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:33:55 2021] POST /identity/v3/users => generated 289 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:33:56.095055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:56.118382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b867b-0b2d-4d41-879f-bdbba8742048 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:56.136972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:56.136972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:56.136972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:56.136972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:56.137247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:56.137247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:56.177390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 880/1764] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:56 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:56.181619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:56.201005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e21ed-2b1a-43cf-8341-410570807b8d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:56.220059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:56.224531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:56.224893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:56.226006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] PATH_INFO: `/v3/projects/52323a2766a44016a042b25121054a31/users/8671eea692ff4bce906b090e392e95e7/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:56.268160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52323a2766a44016a042b25121054a31, user_id=8671eea692ff4bce906b090e392e95e7, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:56.288240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:56.578560 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 885/1765] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:56 2021] PUT /identity/v3/projects/52323a2766a44016a042b25121054a31/users/8671eea692ff4bce906b090e392e95e7/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:33:56.582636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:56.600496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b46146-9ef3-487d-9852-df9d8290b676 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:56.603038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:56.605460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:56.781426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ba794-aeb6-4efb-9b9b-2d80d3014563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:56.781426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ba794-aeb6-4efb-9b9b-2d80d3014563 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:56.781426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ba794-aeb6-4efb-9b9b-2d80d3014563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:56.781426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ba794-aeb6-4efb-9b9b-2d80d3014563 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:56.781739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ba794-aeb6-4efb-9b9b-2d80d3014563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:56.781739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ba794-aeb6-4efb-9b9b-2d80d3014563 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:56.784430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 881/1766] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:33:56 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:33:56.786266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30603b0a-1de7-4480-9297-af25861ba772 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:56.786682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30603b0a-1de7-4480-9297-af25861ba772 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:56.788668 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30603b0a-1de7-4480-9297-af25861ba772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:56.806275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199776-d722-4df9-adb7-ad9cb0ee9342 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:56.813178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:56.814308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-30603b0a-1de7-4480-9297-af25861ba772 None None] MFA Rules not processed for user `c0e12bd4237643e99e03e73f6c5c69f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:56.814852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:56.815353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:56.815599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-30603b0a-1de7-4480-9297-af25861ba772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:56.816217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] PATH_INFO: `/v3/projects/efed960bf2e84eebb31e01198a437256` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:56.821517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efed960bf2e84eebb31e01198a437256)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:56.823832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:56.916243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 882/1767] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:56 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:56.917321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30603b0a-1de7-4480-9297-af25861ba772 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:56.983585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30603b0a-1de7-4480-9297-af25861ba772 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:56.992132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efed960bf2e84eebb31e01198a437256', 'request_id': 'req-446d9369-4786-49e4-8100-20fbba133069'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.013471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efed960bf2e84eebb31e01198a437256', 'request_id': 'req-446d9369-4786-49e4-8100-20fbba133069'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.117835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efed960bf2e84eebb31e01198a437256', 'request_id': 'req-446d9369-4786-49e4-8100-20fbba133069'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.155384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] The token cache is being invalidate because project efed960bf2e84eebb31e01198a437256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:57.155642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.157206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.165419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 886/1768] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:56 2021] DELETE /identity/v3/projects/efed960bf2e84eebb31e01198a437256 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:33:57.165419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:57.171296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:57.173020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:57.174976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:57.175564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:57.176055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] PATH_INFO: `/v3/projects/52323a2766a44016a042b25121054a31/users/8671eea692ff4bce906b090e392e95e7/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:57.181167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52323a2766a44016a042b25121054a31, user_id=8671eea692ff4bce906b090e392e95e7, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:57.186400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:57.202342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9369-4786-49e4-8100-20fbba133069 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:57.214844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 883/1769] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:33:56 2021] PUT /identity/v3/projects/52323a2766a44016a042b25121054a31/users/8671eea692ff4bce906b090e392e95e7/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:57.216900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:57.221688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:57.329463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:57.330566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:57.333877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:57.334306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] PATH_INFO: `/v3/projects/d09a340c791542fa855da0230d54aad1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:57.336364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09a340c791542fa855da0230d54aad1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:57.341640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:57.373728 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032e73-3d74-4c39-a76a-2587c1a86e39 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:57.380623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:57.385091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:57.385091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:57.385091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] PATH_INFO: `/v3/users/505c8a260f1b49eba58bfd7d3a5c43c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:57.385091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505c8a260f1b49eba58bfd7d3a5c43c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:57.386870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:57.633600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09a340c791542fa855da0230d54aad1', 'request_id': 'req-faf5f7d8-bd49-43e8-b06c-363e21783e87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.633851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505c8a260f1b49eba58bfd7d3a5c43c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.633851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505c8a260f1b49eba58bfd7d3a5c43c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.637713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09a340c791542fa855da0230d54aad1', 'request_id': 'req-faf5f7d8-bd49-43e8-b06c-363e21783e87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.682745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505c8a260f1b49eba58bfd7d3a5c43c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.683820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505c8a260f1b49eba58bfd7d3a5c43c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.835451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09a340c791542fa855da0230d54aad1', 'request_id': 'req-faf5f7d8-bd49-43e8-b06c-363e21783e87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.855929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] The token cache is being invalidate because project d09a340c791542fa855da0230d54aad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:57.857438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.858600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-faf5f7d8-bd49-43e8-b06c-363e21783e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.861662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 887/1770] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:57 2021] DELETE /identity/v3/projects/d09a340c791542fa855da0230d54aad1 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:57.864211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfb294-0aaa-436c-b585-d2695fd82d10 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:57.864965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfb294-0aaa-436c-b585-d2695fd82d10 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:57.865314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfb294-0aaa-436c-b585-d2695fd82d10 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:57.867523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 888/1771] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:33:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:33:57.869336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f0ce-534d-4980-83e7-87a75c5aa57f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:57.870029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f0ce-534d-4980-83e7-87a75c5aa57f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:57.879751 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f0ce-534d-4980-83e7-87a75c5aa57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:57.928973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5b54f0ce-534d-4980-83e7-87a75c5aa57f None None] MFA Rules not processed for user `8671eea692ff4bce906b090e392e95e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:57.930591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5b54f0ce-534d-4980-83e7-87a75c5aa57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:57.967410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505c8a260f1b49eba58bfd7d3a5c43c8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:57.990320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 884/1772] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:57 2021] DELETE /identity/v3/users/505c8a260f1b49eba58bfd7d3a5c43c8 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:57.993864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:57.999451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:58.060105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 889/1773] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:57 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:58.061445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:58.061750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:58.062033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:58.084479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:58.085869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:58.149837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a5724-35cb-40e6-a1db-925973197c99 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:58.159374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:58.165079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:58.165368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:58.166748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] PATH_INFO: `/v3/users/25c995c3e8114847887f1e4e35e99424` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:58.175359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c995c3e8114847887f1e4e35e99424)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:58.182105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:58.215374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 890/1774] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:33:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:33:58.217549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:58.219718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:58.317146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf5e64-22ce-4cb8-9f68-3bf9b790050f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:58.324063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:58.325104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:58.326595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:58.327161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:58.434320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c995c3e8114847887f1e4e35e99424'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:58.435622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c995c3e8114847887f1e4e35e99424'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:58.436439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:58.437975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:58.453665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c995c3e8114847887f1e4e35e99424'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:58.455068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c995c3e8114847887f1e4e35e99424'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:58.484721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 891/1775] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:58 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:58.487963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:58.493297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:58.549732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c995c3e8114847887f1e4e35e99424'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:58.558125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ca29-e0f5-4684-9fed-9e6c2c2c8971 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:58.570874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 885/1776] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:33:57 2021] DELETE /identity/v3/users/25c995c3e8114847887f1e4e35e99424 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:58.576277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:58.576702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:58.577032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:58.577289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:58.579351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:58.616537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:58.620940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:58.652442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 892/1777] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:58.810814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:58.812350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:58.929425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e27a7e-6598-4888-ad52-3985b605f1e0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:58.947551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:58.948336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:58.948621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:58.948947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:58.951475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:59.041386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:59.043510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:59.055287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 886/1778] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:33:58 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:33:59.061647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:59.067725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:59.088810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ec9b-141a-41a7-a6fc-6ef7956c22f9 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:59.267523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:33:59.268171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:59.268612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:59.269060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] PATH_INFO: `/v3/projects/37723fe60dd245949a667cbe62f6288b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:59.273561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37723fe60dd245949a667cbe62f6288b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:33:59.277545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:33:59.502030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37723fe60dd245949a667cbe62f6288b', 'request_id': 'req-d3754031-8cf7-44bb-98bb-c6b912eb034b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:59.521151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37723fe60dd245949a667cbe62f6288b', 'request_id': 'req-d3754031-8cf7-44bb-98bb-c6b912eb034b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:59.850235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37723fe60dd245949a667cbe62f6288b', 'request_id': 'req-d3754031-8cf7-44bb-98bb-c6b912eb034b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:59.859267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:33:59.861316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:33:59.865510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] The token cache is being invalidate because project 37723fe60dd245949a667cbe62f6288b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:33:59.865806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:59.873785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d3754031-8cf7-44bb-98bb-c6b912eb034b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:33:59.876123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 893/1779] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:59 2021] DELETE /identity/v3/projects/37723fe60dd245949a667cbe62f6288b => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:33:59.878234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6252b-be6d-4a2b-8d33-dee2a9ad773d service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:33:59.886148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06eeee-5877-4036-b6dc-78b0865bff99 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:33:59.894144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06eeee-5877-4036-b6dc-78b0865bff99 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:33:59.894144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06eeee-5877-4036-b6dc-78b0865bff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:33:59.954967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4e06eeee-5877-4036-b6dc-78b0865bff99 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:33:59.954967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4e06eeee-5877-4036-b6dc-78b0865bff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:00.022826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.030053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.030053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.030053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] PATH_INFO: `/v3/projects/e8a00a6f8d924eefb475e52141e90d28` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.030964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a00a6f8d924eefb475e52141e90d28)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.033071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.041033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 894/1780] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:33:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:00.052118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d18d1-6056-44b5-aa01-8ec607139e60 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.052762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d18d1-6056-44b5-aa01-8ec607139e60 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.053209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d18d1-6056-44b5-aa01-8ec607139e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.101298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1c4d18d1-6056-44b5-aa01-8ec607139e60 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:00.103158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1c4d18d1-6056-44b5-aa01-8ec607139e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:00.115628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 895/1781] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:00.116689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d18d1-6056-44b5-aa01-8ec607139e60 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.125862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d18d1-6056-44b5-aa01-8ec607139e60 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.130518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.131168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.131448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.131728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.132651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:00.132996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.134958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.149107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 896/1782] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:34:00.153292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.165471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b629267-7d52-4498-be20-a077e75592a5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.170434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.171093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.171394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.171671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.172389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.174449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.332042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a00a6f8d924eefb475e52141e90d28', 'request_id': 'req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:00.337534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a00a6f8d924eefb475e52141e90d28', 'request_id': 'req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:00.407615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 897/1783] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:00 2021] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:00.413648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.432246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a00a6f8d924eefb475e52141e90d28', 'request_id': 'req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:00.448818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] The token cache is being invalidate because project e8a00a6f8d924eefb475e52141e90d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:00.449115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:00.454661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8e37450b-9a68-49e4-b9f8-e4e2d0d705fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:00.463208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 887/1784] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:33:59 2021] DELETE /identity/v3/projects/e8a00a6f8d924eefb475e52141e90d28 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:00.466877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4f65-b750-460e-a43f-8b19a83dd04e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.470789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4f65-b750-460e-a43f-8b19a83dd04e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.470789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4f65-b750-460e-a43f-8b19a83dd04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.499237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-27dd4f65-b750-460e-a43f-8b19a83dd04e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:00.504541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-27dd4f65-b750-460e-a43f-8b19a83dd04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:00.521051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c8b14-6de6-4305-8c52-2ca93096a895 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.526388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.527238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.527531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.527806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.528817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.530956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.569043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 888/1785] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:00.577436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247ae6-f42a-4a45-992e-d9f710d91f5e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.577725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247ae6-f42a-4a45-992e-d9f710d91f5e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.578207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68247ae6-f42a-4a45-992e-d9f710d91f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.602622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-68247ae6-f42a-4a45-992e-d9f710d91f5e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:00.603024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-68247ae6-f42a-4a45-992e-d9f710d91f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:00.617828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 889/1786] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:00.618860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68247ae6-f42a-4a45-992e-d9f710d91f5e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.632702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68247ae6-f42a-4a45-992e-d9f710d91f5e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.643038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 898/1787] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:00 2021] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:00.645087 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.646161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.646983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.647425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.647834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.648690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:00.649211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.650954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:00.651338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.668288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 890/1788] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:34:00.673988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.679738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579fd3d-795d-42f1-8075-4a42d6837a76 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.692698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.694408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.694408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.694408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.703530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.705281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.705428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5318-c055-4dc2-8fb4-90d87195322d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.729233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.730005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.730324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.730656 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.732011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.733827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 899/1789] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:00 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:34:00.734768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.750473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.761710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990d19b-dd9a-4060-96dd-f0d287309a2c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.766818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.767795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.768103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.768406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.769154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.770950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.797958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 900/1790] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:00 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:00.804277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.830210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b8463-cae3-41e9-8b97-db1e5dc325e7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.843328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89850b2-6c01-4ddb-8971-da63aa999373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.844244 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89850b2-6c01-4ddb-8971-da63aa999373 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.844509 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89850b2-6c01-4ddb-8971-da63aa999373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.844839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89850b2-6c01-4ddb-8971-da63aa999373 admin admin] PATH_INFO: `/v3/projects/6fa0a793ad874332923b20a1a89ae882/users/290616ea24ed41758da38c043c7c61e6/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.864241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89850b2-6c01-4ddb-8971-da63aa999373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa0a793ad874332923b20a1a89ae882, user_id=290616ea24ed41758da38c043c7c61e6, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.867687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89850b2-6c01-4ddb-8971-da63aa999373 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:00.879707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 891/1791] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:00 2021] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:00.885358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:00.970227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd012c9-dd5d-4b17-acf4-bef8a980c46c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:00.979307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:00.980225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:00.980581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:00.981078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:00.982211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 901/1792] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:00 2021] PUT /identity/v3/projects/6fa0a793ad874332923b20a1a89ae882/users/290616ea24ed41758da38c043c7c61e6/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:00.982814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:00.986306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.021789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8a6d1-3674-407e-9761-059b6199ed18 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.033231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8a6d1-3674-407e-9761-059b6199ed18 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.033231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8a6d1-3674-407e-9761-059b6199ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.085714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-14b8a6d1-3674-407e-9761-059b6199ed18 None None] MFA Rules not processed for user `290616ea24ed41758da38c043c7c61e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:01.087111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-14b8a6d1-3674-407e-9761-059b6199ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:01.173804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 902/1793] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:01 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:01.178257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8a6d1-3674-407e-9761-059b6199ed18 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.268808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8a6d1-3674-407e-9761-059b6199ed18 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.275677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.276345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.276626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.276902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.277614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.279684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.318719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 892/1794] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:00 2021] POST /identity/v3/users => generated 283 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:01.319848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.331665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedf2d-ead2-4a2a-9e79-e219636f038a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.344651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.345339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.345626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.345902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.346719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.348436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.359453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 893/1795] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:01.363203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.375127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b71f77-7e6f-4bb5-81bf-d6b67da82939 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.379770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.380442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.380738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.381002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.381746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.383836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.393142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 903/1796] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:01 2021] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:01.396311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 894/1797] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:34:01.397225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.400601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.413535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afbc6-8018-430f-b84c-e80575a35920 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.484596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02625a4-6985-48d0-bd14-342f237fdead admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.490414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.491264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.491689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.492029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.492810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.500288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.515866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cea691-75c1-463b-89ee-6726b71fa42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.520557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea691-75c1-463b-89ee-6726b71fa42c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.520557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea691-75c1-463b-89ee-6726b71fa42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.520557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea691-75c1-463b-89ee-6726b71fa42c admin admin] PATH_INFO: `/v3/projects/22491f32641148ed9f96850a7343ecb5/users/893cd456d07e4a2c84ef7c22ec6574ad/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.535908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cea691-75c1-463b-89ee-6726b71fa42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22491f32641148ed9f96850a7343ecb5, user_id=893cd456d07e4a2c84ef7c22ec6574ad, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.538822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cea691-75c1-463b-89ee-6726b71fa42c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.696261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 904/1798] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:01 2021] POST /identity/v3/users => generated 296 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:01.700271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.710373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883527cd-5177-45b7-9ea9-d951342d6511 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.736910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 895/1799] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:01 2021] PUT /identity/v3/projects/22491f32641148ed9f96850a7343ecb5/users/893cd456d07e4a2c84ef7c22ec6574ad/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:01.737068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.737068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.737068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.737068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.737422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.737422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.738923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ddc4-ee0b-4001-8e26-f9892405bb35 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.739282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ddc4-ee0b-4001-8e26-f9892405bb35 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.739645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ddc4-ee0b-4001-8e26-f9892405bb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.755691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 905/1800] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:34:01.756878 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.772788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9838ddc4-ee0b-4001-8e26-f9892405bb35 None None] MFA Rules not processed for user `893cd456d07e4a2c84ef7c22ec6574ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:01.776490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9838ddc4-ee0b-4001-8e26-f9892405bb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:01.788312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b3f65-1f50-4ac0-9d37-b822c6d2ea94 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.893189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 896/1801] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:01 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:01.894626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ddc4-ee0b-4001-8e26-f9892405bb35 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:01.895823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.896744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.897030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.897321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] PATH_INFO: `/v3/projects/27ae7edf464c40efa3ecfabfb8551cc3/users/232c0e8d2f2a4a44a3a416cd32abbc88/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.941539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ddc4-ee0b-4001-8e26-f9892405bb35 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:01.952665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ae7edf464c40efa3ecfabfb8551cc3, user_id=232c0e8d2f2a4a44a3a416cd32abbc88, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.955382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:01.962258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:01.963230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:01.963510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:01.963789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:01.964516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:01.971482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.048841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 906/1802] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:01 2021] PUT /identity/v3/projects/27ae7edf464c40efa3ecfabfb8551cc3/users/232c0e8d2f2a4a44a3a416cd32abbc88/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:02.053464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.083105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 897/1803] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:01 2021] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:02.086982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.187926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a9680-cc71-46f0-9084-6c8475a81667 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.212044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45045b-82b6-4fea-a776-34f155c0b17c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.219357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.220097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.220380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.220657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.221434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.224320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.314437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.315125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.315461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.315685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.316960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.318749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.334749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 907/1804] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:02.339567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.355183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b376c79-5941-4f66-b5b4-b55dc8df73de admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.361860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c076336-7d1c-4dac-8e56-be2728975e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.363183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c076336-7d1c-4dac-8e56-be2728975e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.363702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c076336-7d1c-4dac-8e56-be2728975e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.364054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c076336-7d1c-4dac-8e56-be2728975e2b admin admin] PATH_INFO: `/v3/projects/27ae7edf464c40efa3ecfabfb8551cc3/users/232c0e8d2f2a4a44a3a416cd32abbc88/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.366678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c076336-7d1c-4dac-8e56-be2728975e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ae7edf464c40efa3ecfabfb8551cc3, user_id=232c0e8d2f2a4a44a3a416cd32abbc88, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.370421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c076336-7d1c-4dac-8e56-be2728975e2b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.387941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 908/1805] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:02 2021] PUT /identity/v3/projects/27ae7edf464c40efa3ecfabfb8551cc3/users/232c0e8d2f2a4a44a3a416cd32abbc88/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:02.396827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.397118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.397399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.439141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] MFA Rules not processed for user `232c0e8d2f2a4a44a3a416cd32abbc88`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:02.440414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:02.516091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 898/1806] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:02 2021] POST /identity/v3/users => generated 289 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:02.520314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 909/1807] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:02 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:02.521367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.533139 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c8fd-a5db-47c8-b3d9-1fe1262d972c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.543063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.543063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:02.590370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.591068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.591363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.591638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.592405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.594067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.604649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 899/1808] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:02.605117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93105601-22a6-4cdb-9905-b9f9e08c4851 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.609080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.612974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.613637 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.614084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.614537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.619104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaac1a9-27bf-4414-9404-99d241714279 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.625198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.625501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.626036 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.626367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.626649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] PATH_INFO: `/v3/projects/d8d8e9dd3aee4e06b570ce7a69b6a1ec/users/3969c2b7bfbe4f96bb9758a3b5d02a9a/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.626982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.639678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 910/1809] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:02 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:02.644091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d8e9dd3aee4e06b570ce7a69b6a1ec, user_id=3969c2b7bfbe4f96bb9758a3b5d02a9a, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.647167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.721355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 900/1810] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:02 2021] PUT /identity/v3/projects/d8d8e9dd3aee4e06b570ce7a69b6a1ec/users/3969c2b7bfbe4f96bb9758a3b5d02a9a/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:02.729595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.740478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb53c6b-4ab5-4960-818f-2d38db1fee3f service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.795789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc177c-a1d4-42de-a892-32013c15b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.796495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc177c-a1d4-42de-a892-32013c15b982 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.796778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc177c-a1d4-42de-a892-32013c15b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.797057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc177c-a1d4-42de-a892-32013c15b982 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.797803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc177c-a1d4-42de-a892-32013c15b982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.799443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc177c-a1d4-42de-a892-32013c15b982 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.809315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 911/1811] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:02.813503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:02.823594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe41b5d-d822-4e23-aa51-a07cb175ac0e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:02.828396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:02.833157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.833157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.833157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] PATH_INFO: `/v3/projects/d8d8e9dd3aee4e06b570ce7a69b6a1ec/users/3969c2b7bfbe4f96bb9758a3b5d02a9a/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.833157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d8e9dd3aee4e06b570ce7a69b6a1ec, user_id=3969c2b7bfbe4f96bb9758a3b5d02a9a, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:02.834514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:02.845593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 901/1812] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:02 2021] PUT /identity/v3/projects/d8d8e9dd3aee4e06b570ce7a69b6a1ec/users/3969c2b7bfbe4f96bb9758a3b5d02a9a/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:02.855776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497410-911e-4977-8a6d-c32310ad972d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:02.857036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497410-911e-4977-8a6d-c32310ad972d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:02.857536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497410-911e-4977-8a6d-c32310ad972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:02.884976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-51497410-911e-4977-8a6d-c32310ad972d None None] MFA Rules not processed for user `3969c2b7bfbe4f96bb9758a3b5d02a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:02.886221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-51497410-911e-4977-8a6d-c32310ad972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:02.952662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 912/1813] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:02 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:03.040493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:03.042802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:03.118740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f571b2-439e-4a0a-b9c2-ffcf1234f229 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:03.124266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:03.125120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:03.125414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:03.125870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:03.138137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:03.140605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:03.170030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 902/1814] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:03 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:03.925321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51497410-911e-4977-8a6d-c32310ad972d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:04.032291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51497410-911e-4977-8a6d-c32310ad972d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:04.037612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232c0e8d2f2a4a44a3a416cd32abbc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae7edf464c40efa3ecfabfb8551cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:04.038630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:04.039107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:04.039533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:04.040530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:04.041014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:04.043217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:04.067006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 913/1815] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:34:04.067168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:04.078787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abcad5-761e-4b66-9d27-e57492bb52a6 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:04.089845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232c0e8d2f2a4a44a3a416cd32abbc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae7edf464c40efa3ecfabfb8551cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:04.091037 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:04.098171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:04.098171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:04.098171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:04.098171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:04.185664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:04.247586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 903/1816] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:04 2021] POST /identity/v3/projects => generated 354 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:04.251534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:04.280586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd02f9-ad39-46a1-8815-d9eac4ca42f5 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:04.387316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:04.389508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:04.389797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:04.390454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] PATH_INFO: `/v3/users/893cd456d07e4a2c84ef7c22ec6574ad` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:04.392191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=893cd456d07e4a2c84ef7c22ec6574ad)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:04.394793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:04.446502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd5c2a-4fb3-4b7c-91a7-32b93ef5acd6 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:04.459649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232c0e8d2f2a4a44a3a416cd32abbc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae7edf464c40efa3ecfabfb8551cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:04.462245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:04.462548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:04.462839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:04.463614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:04.463932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:04.467211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:04.513603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 904/1817] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:34:04.646842 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893cd456d07e4a2c84ef7c22ec6574ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:04.657247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:04.676622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893cd456d07e4a2c84ef7c22ec6574ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:04.678550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893cd456d07e4a2c84ef7c22ec6574ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:04.680081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893cd456d07e4a2c84ef7c22ec6574ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:04.683188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f40e-43e8-4d4d-8602-f328942ad465 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:04.697816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a90a4365-f64e-4247-8627-1a3a716b90ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893cd456d07e4a2c84ef7c22ec6574ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:04.698022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '232c0e8d2f2a4a44a3a416cd32abbc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae7edf464c40efa3ecfabfb8551cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:04.698746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:04.699038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:04.708610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] PATH_INFO: `/v3/projects/f9dbe60d67854910ab8f0265eba7981a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:04.711921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f9dbe60d67854910ab8f0265eba7981a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:04.718573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:04.842240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 914/1818] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:04 2021] DELETE /identity/v3/users/893cd456d07e4a2c84ef7c22ec6574ad => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:04.847468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960777b4-1d37-4359-943a-327326617f68 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:04.847765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960777b4-1d37-4359-943a-327326617f68 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:04.848068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960777b4-1d37-4359-943a-327326617f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:04.869300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-960777b4-1d37-4359-943a-327326617f68 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:04.870809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-960777b4-1d37-4359-943a-327326617f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:04.901128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dbe60d67854910ab8f0265eba7981a', 'request_id': 'req-3e5442e4-9984-4cec-891e-1aa8542f7243'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:04.909463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dbe60d67854910ab8f0265eba7981a', 'request_id': 'req-3e5442e4-9984-4cec-891e-1aa8542f7243'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:04.952845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 915/1819] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:04.965729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960777b4-1d37-4359-943a-327326617f68 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:04.968119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-960777b4-1d37-4359-943a-327326617f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:05.054408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960777b4-1d37-4359-943a-327326617f68 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:05.057979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dbe60d67854910ab8f0265eba7981a', 'request_id': 'req-3e5442e4-9984-4cec-891e-1aa8542f7243'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:05.073958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] The token cache is being invalidate because project f9dbe60d67854910ab8f0265eba7981a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:05.074567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:05.079433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:05.081355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 905/1820] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:04 2021] DELETE /identity/v3/projects/f9dbe60d67854910ab8f0265eba7981a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:05.151579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:05.152255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:05.152539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:05.152826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:05.155652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:05.242847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:05.244296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:05.276682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 916/1821] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:34:05.783743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:05.785286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:05.803346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:05.805045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:05.820807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c49d1-5d50-4867-844f-e5e52a2b8ab2 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:05.827216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5442e4-9984-4cec-891e-1aa8542f7243 tempest-VolumeQuotaClassesTest-553359805 tempest-VolumeQuotaClassesTest-553359805-project-admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:05.837892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:05.837892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:05.837892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:05.837892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] PATH_INFO: `/v3/projects/22491f32641148ed9f96850a7343ecb5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:05.838646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22491f32641148ed9f96850a7343ecb5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:05.839545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:05.840183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:05.840423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:05.840719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:05.841533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] PATH_INFO: `/v3/users/290616ea24ed41758da38c043c7c61e6` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:05.842974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290616ea24ed41758da38c043c7c61e6)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:05.844936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:05.951722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22491f32641148ed9f96850a7343ecb5', 'request_id': 'req-b551a492-3989-4e9b-96cc-c60a9b0623d1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:05.957356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22491f32641148ed9f96850a7343ecb5', 'request_id': 'req-b551a492-3989-4e9b-96cc-c60a9b0623d1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.017964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22491f32641148ed9f96850a7343ecb5', 'request_id': 'req-b551a492-3989-4e9b-96cc-c60a9b0623d1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.030073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] The token cache is being invalidate because project 22491f32641148ed9f96850a7343ecb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:06.030423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.031176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.032708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 906/1822] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:05 2021] DELETE /identity/v3/projects/22491f32641148ed9f96850a7343ecb5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:06.041030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:06.041030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:06.074422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290616ea24ed41758da38c043c7c61e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.092768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290616ea24ed41758da38c043c7c61e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.093683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290616ea24ed41758da38c043c7c61e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.094397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290616ea24ed41758da38c043c7c61e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.101843 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-697464a5-3c56-4705-a7ef-8fded7535995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290616ea24ed41758da38c043c7c61e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.105095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551a492-3989-4e9b-96cc-c60a9b0623d1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:06.109848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:06.110753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:06.111032 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:06.111307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] PATH_INFO: `/v3/users/3969c2b7bfbe4f96bb9758a3b5d02a9a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:06.112631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3969c2b7bfbe4f96bb9758a3b5d02a9a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:06.114592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:06.185934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 917/1823] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:05 2021] DELETE /identity/v3/users/290616ea24ed41758da38c043c7c61e6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:06.190693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:06.191057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:06.191410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:06.210857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:06.212148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:06.274340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 918/1824] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:06.285858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:06.287573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:06.327166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3969c2b7bfbe4f96bb9758a3b5d02a9a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.328213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3969c2b7bfbe4f96bb9758a3b5d02a9a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.340922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3969c2b7bfbe4f96bb9758a3b5d02a9a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.342531 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3969c2b7bfbe4f96bb9758a3b5d02a9a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.364082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83ffd-2a3c-474d-8a41-9c5c930d8aec None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:06.368165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:06.368898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:06.369196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:06.369488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:06.371526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:06.384456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:06.391067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:06.401505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 919/1825] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:34:06.423500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3969c2b7bfbe4f96bb9758a3b5d02a9a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:06.436771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 907/1826] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:06 2021] DELETE /identity/v3/users/3969c2b7bfbe4f96bb9758a3b5d02a9a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:06.840212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:06.842832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:06.872169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb51c1-5975-461a-9c79-b0095b5329b4 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:06.940715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:06.941733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:06.942020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:06.942360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] PATH_INFO: `/v3/projects/6fa0a793ad874332923b20a1a89ae882` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:06.943563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa0a793ad874332923b20a1a89ae882)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:06.945515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:07.077456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:07.084577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:07.093187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a8265-b0b9-4786-a334-046002ad78eb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:07.098019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:07.098917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.099186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.099498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] PATH_INFO: `/v3/projects/d8d8e9dd3aee4e06b570ce7a69b6a1ec` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.100660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d8e9dd3aee4e06b570ce7a69b6a1ec)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:07.102619 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:07.133520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa0a793ad874332923b20a1a89ae882', 'request_id': 'req-98160597-0353-4b23-91ea-35e54bbff543'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.140783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa0a793ad874332923b20a1a89ae882', 'request_id': 'req-98160597-0353-4b23-91ea-35e54bbff543'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.246466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa0a793ad874332923b20a1a89ae882', 'request_id': 'req-98160597-0353-4b23-91ea-35e54bbff543'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.257147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d8e9dd3aee4e06b570ce7a69b6a1ec', 'request_id': 'req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.259170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] The token cache is being invalidate because project 6fa0a793ad874332923b20a1a89ae882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:07.259719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.260172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.261860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 920/1827] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:06 2021] DELETE /identity/v3/projects/6fa0a793ad874332923b20a1a89ae882 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:07.264877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d8e9dd3aee4e06b570ce7a69b6a1ec', 'request_id': 'req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.266405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:07.268061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:07.330532 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98160597-0353-4b23-91ea-35e54bbff543 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:07.343645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d8e9dd3aee4e06b570ce7a69b6a1ec', 'request_id': 'req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.356232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] The token cache is being invalidate because project d8d8e9dd3aee4e06b570ce7a69b6a1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:07.359006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.359006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-af3ddf0e-8b25-4a77-ba60-60b2773b7db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.359194 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 908/1828] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:07 2021] DELETE /identity/v3/projects/d8d8e9dd3aee4e06b570ce7a69b6a1ec => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:07.364755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f1793-f281-4895-81ab-6bb717ad25db None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.365188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f1793-f281-4895-81ab-6bb717ad25db None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.365395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f1793-f281-4895-81ab-6bb717ad25db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.385754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-687f1793-f281-4895-81ab-6bb717ad25db None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:07.387025 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-687f1793-f281-4895-81ab-6bb717ad25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:07.393974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:07.394865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.395147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.397191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] PATH_INFO: `/v3/users/232c0e8d2f2a4a44a3a416cd32abbc88` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.397398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=232c0e8d2f2a4a44a3a416cd32abbc88)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:07.400407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:07.451805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 909/1829] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:07.466662 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5c56-3e72-4a48-8044-26aa87601489 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.466959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5c56-3e72-4a48-8044-26aa87601489 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.467238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5c56-3e72-4a48-8044-26aa87601489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.485960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a87e5c56-3e72-4a48-8044-26aa87601489 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:07.487311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a87e5c56-3e72-4a48-8044-26aa87601489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:07.497565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 910/1830] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:07.504954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5c56-3e72-4a48-8044-26aa87601489 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:07.516153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5c56-3e72-4a48-8044-26aa87601489 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:07.522663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:07.523478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.523994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.524372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.525972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:07.526382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:07.534400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:07.546237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 911/1831] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:34:07.549876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:07.565501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2912c-432a-4961-84d7-fcfea55cfba5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:07.568501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:07.569422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.569740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.570025 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.570774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:07.572695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:07.663681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232c0e8d2f2a4a44a3a416cd32abbc88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.675141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 912/1832] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:07 2021] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:07.676397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:07.685509 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232c0e8d2f2a4a44a3a416cd32abbc88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.686409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232c0e8d2f2a4a44a3a416cd32abbc88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.687022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232c0e8d2f2a4a44a3a416cd32abbc88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.696174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232c0e8d2f2a4a44a3a416cd32abbc88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:07.757145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cae035-c13b-4b8a-b284-232cce99fde4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:07.763010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:07.767172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.767463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.770027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.770027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:07.770901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:07.795590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 921/1833] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:07 2021] DELETE /identity/v3/users/232c0e8d2f2a4a44a3a416cd32abbc88 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:07.866142 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 913/1834] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:07 2021] POST /identity/v3/users => generated 279 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:07.871212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:07.874820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:07.947144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303b16-64f7-471a-b8f4-7c7db467c49b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:07.954943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:07.955643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.955924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.956235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.957032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:07.958650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:07.970338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 922/1835] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:34:07.974148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:07.985781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629de1ed-6e28-414e-8a89-23a1beecf534 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:07.990170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2f68f-56e5-487a-9c6d-cba64a9c3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:07.990874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2f68f-56e5-487a-9c6d-cba64a9c3312 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:07.991155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2f68f-56e5-487a-9c6d-cba64a9c3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:07.991427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2f68f-56e5-487a-9c6d-cba64a9c3312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:07.992226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2f68f-56e5-487a-9c6d-cba64a9c3312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.011569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2f68f-56e5-487a-9c6d-cba64a9c3312 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.024583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 914/1836] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:08.029560 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.040668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942e18-f018-4e5b-876c-2cc684cb0791 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.051233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.052124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.052405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.052680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] PATH_INFO: `/v3/projects/28911cb1285940268adb7f8d3a27ba5f/users/ed244a739a744b67a1e3ab9a139b2593/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.078085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=28911cb1285940268adb7f8d3a27ba5f, user_id=ed244a739a744b67a1e3ab9a139b2593, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.082073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.239235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 923/1837] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:08 2021] PUT /identity/v3/projects/28911cb1285940268adb7f8d3a27ba5f/users/ed244a739a744b67a1e3ab9a139b2593/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:08.250880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277886-ebd5-40dc-8a8e-0a4f78c92627 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.251171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277886-ebd5-40dc-8a8e-0a4f78c92627 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.251647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277886-ebd5-40dc-8a8e-0a4f78c92627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.289744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e4277886-ebd5-40dc-8a8e-0a4f78c92627 None None] MFA Rules not processed for user `ed244a739a744b67a1e3ab9a139b2593`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:08.290961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e4277886-ebd5-40dc-8a8e-0a4f78c92627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:08.342709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.344621 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:08.366253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 915/1838] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:08 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:08.370969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4277886-ebd5-40dc-8a8e-0a4f78c92627 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.423980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80330902-1870-43a3-a67e-66db101e66fc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.438659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.439682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.439969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.440246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] PATH_INFO: `/v3/projects/27ae7edf464c40efa3ecfabfb8551cc3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.442494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ae7edf464c40efa3ecfabfb8551cc3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.444397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.451660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4277886-ebd5-40dc-8a8e-0a4f78c92627 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.469341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.470169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.471108 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.471395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.472547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.476523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.605339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ae7edf464c40efa3ecfabfb8551cc3', 'request_id': 'req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:08.617363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ae7edf464c40efa3ecfabfb8551cc3', 'request_id': 'req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:08.623697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 916/1839] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:08 2021] POST /identity/v3/projects => generated 355 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:08.627185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.696296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ae7edf464c40efa3ecfabfb8551cc3', 'request_id': 'req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:08.728983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] The token cache is being invalidate because project 27ae7edf464c40efa3ecfabfb8551cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:08.730665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:08.731479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f8ad-f588-4442-8791-938fa4bff5e2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.735802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-300e0a27-1c58-4e55-aa4f-fb091e45e8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:08.737015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.738077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.738391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.738669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.739601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.739997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 924/1840] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:08 2021] DELETE /identity/v3/projects/27ae7edf464c40efa3ecfabfb8551cc3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:08.741602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.746036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48c611-d62d-4432-866d-002e46f9ec05 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.746360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48c611-d62d-4432-866d-002e46f9ec05 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.746642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48c611-d62d-4432-866d-002e46f9ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.799350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bb48c611-d62d-4432-866d-002e46f9ec05 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:08.801754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bb48c611-d62d-4432-866d-002e46f9ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:08.824293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 925/1841] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:08.839222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e4c2-73ee-4979-9ab5-1cb1beeec560 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.839222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e4c2-73ee-4979-9ab5-1cb1beeec560 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.839425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e4c2-73ee-4979-9ab5-1cb1beeec560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.875254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 917/1842] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:08 2021] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:08.876509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.880226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:08.888389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-99d8e4c2-73ee-4979-9ab5-1cb1beeec560 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:08.889911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-99d8e4c2-73ee-4979-9ab5-1cb1beeec560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:08.899834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 926/1843] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:08.904227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8e4c2-73ee-4979-9ab5-1cb1beeec560 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.909116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6d881-dabf-439e-81dc-44a749348bbf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.914436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.915222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.915621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.916000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.917552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.918894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.935078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8e4c2-73ee-4979-9ab5-1cb1beeec560 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.935306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 918/1844] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:08 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:08.936643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.938817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.939149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.939273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.939427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.940408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:08.940722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.942420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.951252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29482ea-d23e-418a-9912-df24f9d9e482 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.961365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.962299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.962634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.962852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] PATH_INFO: `/v3/projects/2304dc4353bf45f69d83ec643b2f63aa/users/23a56bfc6961471eaf8a4c22dbfc422b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:08.969579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 927/1845] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:34:08.981046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:08.987957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2304dc4353bf45f69d83ec643b2f63aa, user_id=23a56bfc6961471eaf8a4c22dbfc422b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:08.992165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:08.992971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5a055-8bd2-43bb-9493-946517e515da admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:08.998590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:08.999252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:08.999541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:08.999819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.000538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.002468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.180376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 919/1846] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:08 2021] PUT /identity/v3/projects/2304dc4353bf45f69d83ec643b2f63aa/users/23a56bfc6961471eaf8a4c22dbfc422b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:09.181499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.183752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 928/1847] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:08 2021] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:09.188539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.307981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ebbe-d06d-46a8-8c57-471e51566668 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:09.308473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26b1ff-026b-48c3-8b2f-eaa9e388d22e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:09.316596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:09.317442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.317800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.318224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.319600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:09.319869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.320663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.321016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.321456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.321813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.322304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.328054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.337914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 920/1848] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:09 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:09.339445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.352315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1a1a3-c30c-46c4-9603-cd246a08ae25 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:09.358155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6875d8d-580c-4bdd-8b83-a30b27198503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:09.358298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6875d8d-580c-4bdd-8b83-a30b27198503 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.358589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6875d8d-580c-4bdd-8b83-a30b27198503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.358869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6875d8d-580c-4bdd-8b83-a30b27198503 admin admin] PATH_INFO: `/v3/projects/2304dc4353bf45f69d83ec643b2f63aa/users/23a56bfc6961471eaf8a4c22dbfc422b/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.360917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6875d8d-580c-4bdd-8b83-a30b27198503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2304dc4353bf45f69d83ec643b2f63aa, user_id=23a56bfc6961471eaf8a4c22dbfc422b, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.363663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6875d8d-580c-4bdd-8b83-a30b27198503 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.375201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 921/1849] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:09 2021] PUT /identity/v3/projects/2304dc4353bf45f69d83ec643b2f63aa/users/23a56bfc6961471eaf8a4c22dbfc422b/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:09.386360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.386864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.387476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.419586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] MFA Rules not processed for user `23a56bfc6961471eaf8a4c22dbfc422b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:09.420818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:09.483671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 929/1850] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:09 2021] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:09.485028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.494549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 922/1851] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:09 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:09.496257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481eaeed-b00a-49ac-ac84-254b3e561a84 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:09.506671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.513534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:09.577091 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:09.577924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.578349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.578727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.579622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.582205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.598472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 930/1852] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:09 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:09.599490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.602077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1818-f1a5-4ebe-b62c-ae01e9ff9fec None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:09.608347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bdd0e-829e-4f1c-8876-003e0f599631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:09.609699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bdd0e-829e-4f1c-8876-003e0f599631 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.610162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bdd0e-829e-4f1c-8876-003e0f599631 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.611587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0f6a-364d-4485-86fd-4ff084a7918e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:09.611937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bdd0e-829e-4f1c-8876-003e0f599631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.617188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:09.617985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.618517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.618882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.619896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.622360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.626664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bdd0e-829e-4f1c-8876-003e0f599631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.632143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bdd0e-829e-4f1c-8876-003e0f599631 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.641670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 931/1853] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:09 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:09.643077 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.656780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 923/1854] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:09 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:34:09.658533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd903f91-1643-41b3-97f0-50a99b11ee14 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:09.666115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:09.667181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.667537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.667934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] PATH_INFO: `/v3/projects/a1a1bc4fb6b04667b7e8eadefb8b5279/users/7416e5d2ae0347238b13d4c89a15f893/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.685781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a1bc4fb6b04667b7e8eadefb8b5279, user_id=7416e5d2ae0347238b13d4c89a15f893, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:09.689577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:09.774238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 932/1855] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:09 2021] PUT /identity/v3/projects/a1a1bc4fb6b04667b7e8eadefb8b5279/users/7416e5d2ae0347238b13d4c89a15f893/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:09.786098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af4b4-9b27-4f96-86c9-84813b2765b7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:09.786621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af4b4-9b27-4f96-86c9-84813b2765b7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:09.786761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af4b4-9b27-4f96-86c9-84813b2765b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:09.818194 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7a3af4b4-9b27-4f96-86c9-84813b2765b7 None None] MFA Rules not processed for user `7416e5d2ae0347238b13d4c89a15f893`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:09.819456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7a3af4b4-9b27-4f96-86c9-84813b2765b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:09.899315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:09.919591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 924/1856] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:09.925787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af4b4-9b27-4f96-86c9-84813b2765b7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:10.049548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78052af4-75bc-4fa0-8b1b-abb483c08572 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:10.057775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:10.058488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.062657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.062657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.062821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af4b4-9b27-4f96-86c9-84813b2765b7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:10.064872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:10.067477 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:10.069478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.069478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.069478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.069478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:10.071570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:10.184472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:10.187265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:10.197538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 925/1857] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:09 2021] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:10.207245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:10.213619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 933/1858] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:09 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:34:10.297670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc17b4-3922-4d76-9d02-91d27e8bbf3e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:10.302717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:10.303396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.303811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.304097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.304823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:10.306802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:10.442468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:10.448934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 926/1859] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:10 2021] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:10.499350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5fa01-825d-42ed-89c3-7ba77167a2d5 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:10.518158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:10.519153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.519453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.519731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.520602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:10.522676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:10.536467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 934/1860] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:10 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:10.544987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:10.557786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413df4f-22ad-485a-a274-85d2d47acae1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:10.563512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fe6bc-13d7-4019-9bb9-b4d0d43fb926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:10.564256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fe6bc-13d7-4019-9bb9-b4d0d43fb926 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.564549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fe6bc-13d7-4019-9bb9-b4d0d43fb926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.565996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fe6bc-13d7-4019-9bb9-b4d0d43fb926 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.565996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fe6bc-13d7-4019-9bb9-b4d0d43fb926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:10.567597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fe6bc-13d7-4019-9bb9-b4d0d43fb926 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:10.579234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 927/1861] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:10 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:10.584101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:10.601786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a190d2-b047-4016-9d26-0d685ca23a0b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:10.606807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:10.607698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.612340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.612340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] PATH_INFO: `/v3/projects/1a817bfb82a34e829921a9860c84d3e0/users/825bd7aa407c4f1ab7ac9d1a127ffb04/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.635133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a817bfb82a34e829921a9860c84d3e0, user_id=825bd7aa407c4f1ab7ac9d1a127ffb04, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:10.642727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:10.753270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 935/1862] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:10 2021] PUT /identity/v3/projects/1a817bfb82a34e829921a9860c84d3e0/users/825bd7aa407c4f1ab7ac9d1a127ffb04/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:10.763924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269c79-df02-4104-be88-c58b085b5a40 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.764271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269c79-df02-4104-be88-c58b085b5a40 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.764611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269c79-df02-4104-be88-c58b085b5a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.808771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-52269c79-df02-4104-be88-c58b085b5a40 None None] MFA Rules not processed for user `825bd7aa407c4f1ab7ac9d1a127ffb04`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:10.810125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-52269c79-df02-4104-be88-c58b085b5a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:10.878345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 928/1863] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:10 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:10.882998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:10.949544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d701-2327-4d43-a5e5-595974a426de admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:10.955373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:10.956079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:10.956365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:10.956644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:10.957365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:10.959373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:11.073808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 936/1864] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:10 2021] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:11.074972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269c79-df02-4104-be88-c58b085b5a40 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:11.088513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269c79-df02-4104-be88-c58b085b5a40 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:11.146418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:11.147102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:11.147386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:11.147667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:11.148389 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:11.150513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:11.235864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 929/1865] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:11 2021] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:11.237113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:11.248417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572ae1d-9ece-4e5c-a55e-887967b78c69 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:11.253213 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:11.253882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:11.254219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:11.254505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:11.255258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:11.256844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:11.268972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 937/1866] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:11.273643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:11.285358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee879ff0-2e4d-4dfa-9833-83105f150415 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:11.292463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:11.293372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:11.293657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:11.294168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] PATH_INFO: `/v3/projects/07c8d5d8ce154178ba6e457e32daf5c1/users/988637bd1b0a4bc58452471fedacc2bc/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:11.312380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c8d5d8ce154178ba6e457e32daf5c1, user_id=988637bd1b0a4bc58452471fedacc2bc, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:11.315179 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:11.381163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 930/1867] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:11 2021] PUT /identity/v3/projects/07c8d5d8ce154178ba6e457e32daf5c1/users/988637bd1b0a4bc58452471fedacc2bc/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:11.383231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:11.393301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c53cb-843b-48d2-bc73-4b0f20cfa8d0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:11.453408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a99b6e-99c4-4830-ae0c-cb8e78c1f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:11.454510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a99b6e-99c4-4830-ae0c-cb8e78c1f83b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:11.454510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a99b6e-99c4-4830-ae0c-cb8e78c1f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:11.454656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a99b6e-99c4-4830-ae0c-cb8e78c1f83b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:11.457016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a99b6e-99c4-4830-ae0c-cb8e78c1f83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:11.457231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a99b6e-99c4-4830-ae0c-cb8e78c1f83b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:11.468432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 938/1868] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:11 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:11.472721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:11.483846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c9cac-0d97-45e6-bfaa-e4bd6d301fde admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:11.492001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:11.493133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:11.493563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:11.493992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] PATH_INFO: `/v3/projects/07c8d5d8ce154178ba6e457e32daf5c1/users/988637bd1b0a4bc58452471fedacc2bc/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:11.496382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c8d5d8ce154178ba6e457e32daf5c1, user_id=988637bd1b0a4bc58452471fedacc2bc, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:11.500026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:11.511518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 931/1869] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:11 2021] PUT /identity/v3/projects/07c8d5d8ce154178ba6e457e32daf5c1/users/988637bd1b0a4bc58452471fedacc2bc/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:11.529541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51db9d1-cc42-49bc-a56f-c6160654a037 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:11.532657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51db9d1-cc42-49bc-a56f-c6160654a037 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:11.533127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51db9d1-cc42-49bc-a56f-c6160654a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:11.578481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f51db9d1-cc42-49bc-a56f-c6160654a037 None None] MFA Rules not processed for user `988637bd1b0a4bc58452471fedacc2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:11.580983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f51db9d1-cc42-49bc-a56f-c6160654a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:11.694117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 939/1870] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:11 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:11.702214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:11.826880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ac35a-1a36-4a8a-bae2-09b1e39e53c2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:11.834624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b545831-30a7-463b-a3ca-ad7243e649d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:11.835303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b545831-30a7-463b-a3ca-ad7243e649d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:11.835594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b545831-30a7-463b-a3ca-ad7243e649d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:11.836548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b545831-30a7-463b-a3ca-ad7243e649d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:11.852338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b545831-30a7-463b-a3ca-ad7243e649d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:11.855479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b545831-30a7-463b-a3ca-ad7243e649d5 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:11.878406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 932/1871] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:11 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:12.066363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d1be9-9f76-4219-bbc7-18b4dc8bf861 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:12.066665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d1be9-9f76-4219-bbc7-18b4dc8bf861 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:12.066980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d1be9-9f76-4219-bbc7-18b4dc8bf861 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:12.069103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 940/1872] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:34:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:34:12.089833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:12.095743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:12.096034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:12.114746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:12.116049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:12.198969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 933/1873] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:34:12 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:12.313988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d1be9-9f76-4219-bbc7-18b4dc8bf861 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:12.315691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-973d1be9-9f76-4219-bbc7-18b4dc8bf861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:12.334460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d1be9-9f76-4219-bbc7-18b4dc8bf861 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:12.340169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e859894-a6d7-40a8-9fcc-33b042712e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:12.340868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859894-a6d7-40a8-9fcc-33b042712e0b service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:12.341947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859894-a6d7-40a8-9fcc-33b042712e0b service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:12.344216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e859894-a6d7-40a8-9fcc-33b042712e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:12.351977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e859894-a6d7-40a8-9fcc-33b042712e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:12.353618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e859894-a6d7-40a8-9fcc-33b042712e0b service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:12.366482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 941/1874] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:12.454489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:12.455932 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:12.561655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241776-646d-450a-8665-6a5d24085ac9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:12.566655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:12.567834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:12.568105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:12.568489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] PATH_INFO: `/v3/users/8034af5beb8e4c56b2ee7826ffb4930d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:12.569929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8034af5beb8e4c56b2ee7826ffb4930d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:12.572598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:12.789036 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8034af5beb8e4c56b2ee7826ffb4930d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:12.790064 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8034af5beb8e4c56b2ee7826ffb4930d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:12.804928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8034af5beb8e4c56b2ee7826ffb4930d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:12.805983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8034af5beb8e4c56b2ee7826ffb4930d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:12.898103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8034af5beb8e4c56b2ee7826ffb4930d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:12.913443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 934/1875] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:12 2021] DELETE /identity/v3/users/8034af5beb8e4c56b2ee7826ffb4930d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:12.918124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:12.919072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:12.919563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:12.939986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:12.941434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:13.025961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 942/1876] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:13.034143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:13.035573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:13.095854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeffb2-0677-4845-89ff-cf90e2d48c03 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:13.099637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:13.100293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:13.100570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:13.100846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:13.110563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:13.112040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:13.121693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 935/1877] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:13.594569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:13.595959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:13.650939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:13.653947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:13.660151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513a02f-ef39-4d33-92bf-5085e8aebbc4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:13.666048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:13.666814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:13.667795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:13.668104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:13.670658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:13.678831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3219c-6a7d-4a4c-8c96-fc4125b3c631 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:13.683721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:13.685319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:13.685677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:13.686240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] PATH_INFO: `/v3/projects/05734ababc0f43088adbe21968ac9557` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:13.687469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05734ababc0f43088adbe21968ac9557)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:13.689554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:13.767889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:13.770169 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:13.790878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05734ababc0f43088adbe21968ac9557', 'request_id': 'req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:13.798248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05734ababc0f43088adbe21968ac9557', 'request_id': 'req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:13.800328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 943/1878] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:13 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:13.875472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05734ababc0f43088adbe21968ac9557', 'request_id': 'req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:13.898173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] The token cache is being invalidate because project 05734ababc0f43088adbe21968ac9557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:13.898515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:13.900420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:13.905685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 936/1879] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:13 2021] DELETE /identity/v3/projects/05734ababc0f43088adbe21968ac9557 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:13.909969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:13.924648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d32e8-5911-4bc0-bbc5-7b507506edd3 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:13.996441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:13.998010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:13.998425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:13.998807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] PATH_INFO: `/v3/users/8671eea692ff4bce906b090e392e95e7` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:14.000215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8671eea692ff4bce906b090e392e95e7)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:14.002830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:14.259737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8671eea692ff4bce906b090e392e95e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:14.284905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8671eea692ff4bce906b090e392e95e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:14.286358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8671eea692ff4bce906b090e392e95e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:14.286701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8671eea692ff4bce906b090e392e95e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:14.295139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-048cc052-2573-4d5a-91a9-568af1124871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8671eea692ff4bce906b090e392e95e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:14.409952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 944/1880] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:13 2021] DELETE /identity/v3/users/8671eea692ff4bce906b090e392e95e7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:14.983378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:14.984877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:14.997867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24693-17c7-4ebb-b29f-7a9ed13016c9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:15.098434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:15.099760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.102415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.102415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] PATH_INFO: `/v3/projects/52323a2766a44016a042b25121054a31` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.102415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] RBAC: Authorizing `identity:delete_project(project_id=52323a2766a44016a042b25121054a31)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:15.104210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:15.280929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52323a2766a44016a042b25121054a31', 'request_id': 'req-4c763ce9-32e6-4944-a02d-0bcb6bf982af'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:15.286589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52323a2766a44016a042b25121054a31', 'request_id': 'req-4c763ce9-32e6-4944-a02d-0bcb6bf982af'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:15.375447 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52323a2766a44016a042b25121054a31', 'request_id': 'req-4c763ce9-32e6-4944-a02d-0bcb6bf982af'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:15.396186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] The token cache is being invalidate because project 52323a2766a44016a042b25121054a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:15.396494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:15.397361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4c763ce9-32e6-4944-a02d-0bcb6bf982af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:15.405186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 937/1881] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:14 2021] DELETE /identity/v3/projects/52323a2766a44016a042b25121054a31 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:15.406883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d029d-2381-431b-a0f6-04d6d727f9ba None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.407437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d029d-2381-431b-a0f6-04d6d727f9ba None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.407671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d029d-2381-431b-a0f6-04d6d727f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.430288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1d6d029d-2381-431b-a0f6-04d6d727f9ba None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:15.431786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1d6d029d-2381-431b-a0f6-04d6d727f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:15.501013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 945/1882] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:15.509470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51eb97-99ef-49f2-aee8-4a9cddfedd4f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.509769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51eb97-99ef-49f2-aee8-4a9cddfedd4f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.510057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51eb97-99ef-49f2-aee8-4a9cddfedd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.536818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ab51eb97-99ef-49f2-aee8-4a9cddfedd4f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:15.536818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ab51eb97-99ef-49f2-aee8-4a9cddfedd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:15.562076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 938/1883] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:15.566530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d029d-2381-431b-a0f6-04d6d727f9ba None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:15.576941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d029d-2381-431b-a0f6-04d6d727f9ba None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:15.582112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:15.582811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.583103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.583380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.584142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:15.584512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:15.586035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:15.607722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 946/1884] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:34:15.609411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51eb97-99ef-49f2-aee8-4a9cddfedd4f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:15.622760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51eb97-99ef-49f2-aee8-4a9cddfedd4f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:15.630780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:15.631637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.632057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.632594 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.633786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:15.636401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:15.746222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 939/1885] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:15 2021] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:15.753351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:15.764394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449590b6-bbd9-44d9-bdeb-c6c59c042546 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:15.819881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:15.820470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.820751 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.821028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.821734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:15.823660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:15.929613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 947/1886] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:15 2021] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:15.933909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:15.944592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c8ff9-45ae-4bda-bca7-6dc032fcbd05 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:15.949206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:15.949853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.950134 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.950592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.951176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:15.952758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:15.962962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 940/1887] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:15.966983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:15.977472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f2d7-a1c4-4f56-8043-5aeb134e3996 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:15.988121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4a7c-24bb-44e6-a907-a49fe87b80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:15.988807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4a7c-24bb-44e6-a907-a49fe87b80f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:15.989095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4a7c-24bb-44e6-a907-a49fe87b80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:15.989381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4a7c-24bb-44e6-a907-a49fe87b80f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:15.990140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4a7c-24bb-44e6-a907-a49fe87b80f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:15.991999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4a7c-24bb-44e6-a907-a49fe87b80f9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.003724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 948/1888] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:16.008116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.020409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cf390-63b0-4995-a96d-ee1d421b1f28 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:16.025820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:16.027138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.027753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.027753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] PATH_INFO: `/v3/projects/a44f37346b994bcf80a383908bb8cc36/users/f9b32d49a64e46a7ac7bc69879940349/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.042786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44f37346b994bcf80a383908bb8cc36, user_id=f9b32d49a64e46a7ac7bc69879940349, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:16.046240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.134757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 941/1889] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:16 2021] PUT /identity/v3/projects/a44f37346b994bcf80a383908bb8cc36/users/f9b32d49a64e46a7ac7bc69879940349/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:16.145082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22132a7a-60ea-47a7-b99d-0cc702963d90 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.145379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22132a7a-60ea-47a7-b99d-0cc702963d90 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.145663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22132a7a-60ea-47a7-b99d-0cc702963d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.172096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-22132a7a-60ea-47a7-b99d-0cc702963d90 None None] MFA Rules not processed for user `f9b32d49a64e46a7ac7bc69879940349`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:16.173353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-22132a7a-60ea-47a7-b99d-0cc702963d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:16.241793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 949/1890] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:16.243172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.309076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e58c6-3647-4edc-8ff1-30fcba674179 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:16.315202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:16.315972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.316351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.316683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.317599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:16.320059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.413060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 942/1891] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:16 2021] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:16.426905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22132a7a-60ea-47a7-b99d-0cc702963d90 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.438001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22132a7a-60ea-47a7-b99d-0cc702963d90 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:16.496541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:16.497304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.497597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.497877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.498679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:16.500723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.581904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 950/1892] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:16 2021] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:16.585578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.597408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c6352-ba63-48e9-8a00-b946dd88bac9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:16.602295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:16.603059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.603340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.603622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.608219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:16.608219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.617447 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 943/1893] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:16.621669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.643970 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e1993-c021-49e4-9b92-647f0fcdcdbe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:16.650010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:16.651094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.651373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.651653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] PATH_INFO: `/v3/projects/4d036d37d18447328d62e6f8d4e41a76/users/d4ec949f1471417683f18ba0b940c648/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.670133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d036d37d18447328d62e6f8d4e41a76, user_id=d4ec949f1471417683f18ba0b940c648, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:16.672978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.755264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 951/1894] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:16 2021] PUT /identity/v3/projects/4d036d37d18447328d62e6f8d4e41a76/users/d4ec949f1471417683f18ba0b940c648/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:16.759467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.770861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9993f-d80a-40c7-b387-e4efe9f87dff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:16.827237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a022c2c-ec27-4fb9-8c2a-fad0c7824489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:16.827927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022c2c-ec27-4fb9-8c2a-fad0c7824489 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.828346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022c2c-ec27-4fb9-8c2a-fad0c7824489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.828633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022c2c-ec27-4fb9-8c2a-fad0c7824489 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.829431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a022c2c-ec27-4fb9-8c2a-fad0c7824489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:16.831090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a022c2c-ec27-4fb9-8c2a-fad0c7824489 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.841566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 944/1895] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:16 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:16.845911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.856412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ada574-4fe2-4e46-bc20-440aaea54336 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:16.861208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:16.862085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.862419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.862803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] PATH_INFO: `/v3/projects/4d036d37d18447328d62e6f8d4e41a76/users/d4ec949f1471417683f18ba0b940c648/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.864689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d036d37d18447328d62e6f8d4e41a76, user_id=d4ec949f1471417683f18ba0b940c648, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:16.867369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:16.878239 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 952/1896] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:16 2021] PUT /identity/v3/projects/4d036d37d18447328d62e6f8d4e41a76/users/d4ec949f1471417683f18ba0b940c648/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:16.889019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:16.889314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:16.889595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:16.916037 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] MFA Rules not processed for user `d4ec949f1471417683f18ba0b940c648`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:16.917222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:16.983258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 945/1897] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:16 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:16.993301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:16.995021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:17.053523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733f34-f8f0-488e-9beb-0b4e9b4d9e71 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:17.057330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:17.057979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:17.058296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:17.058579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:17.117034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:17.118522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:17.127780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 953/1898] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:16 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:29.232870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:29.235497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:29.246408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f78cee-c3c7-48ef-b2a7-49d3c3414e28 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:29.250992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:29.251719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:29.252170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:29.252667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:29.280198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:29.281679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:29.296322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 946/1899] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:29 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:29.998540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:30.006782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becee3c1-92d7-4b40-9f2c-a89d76c5211e service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:30.010533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596b5d-883f-4d3d-b6f8-83336ee9ed7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:30.014923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b5d-883f-4d3d-b6f8-83336ee9ed7d service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:30.014923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b5d-883f-4d3d-b6f8-83336ee9ed7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:30.014923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b5d-883f-4d3d-b6f8-83336ee9ed7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:30.014923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ff596b5d-883f-4d3d-b6f8-83336ee9ed7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:30.071520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596b5d-883f-4d3d-b6f8-83336ee9ed7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:30.073028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596b5d-883f-4d3d-b6f8-83336ee9ed7d service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:30.082650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 954/1900] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:29 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:38.720201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:38.722452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:38.798372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447c686-0907-466b-8717-2f5b7623d88d service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:38.807871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:38.808760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:38.809042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:38.809370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] PATH_INFO: `/v3/users/7416e5d2ae0347238b13d4c89a15f893` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:38.810658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7416e5d2ae0347238b13d4c89a15f893)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:38.812780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:39.060071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7416e5d2ae0347238b13d4c89a15f893'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:39.060714 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7416e5d2ae0347238b13d4c89a15f893'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:39.074286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7416e5d2ae0347238b13d4c89a15f893'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:39.074952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7416e5d2ae0347238b13d4c89a15f893'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:39.162859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7416e5d2ae0347238b13d4c89a15f893'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:39.176543 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 947/1901] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:38 2021] DELETE /identity/v3/users/7416e5d2ae0347238b13d4c89a15f893 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:39.180977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:39.181456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:39.181571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:39.200377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:39.201634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:39.261524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 955/1902] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:39.272521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:39.273933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:39.335481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b32b3-b06c-4312-91ed-81bef2831b4d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:39.341143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:39.342682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:39.343240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:39.343666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:39.362980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:39.364587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:39.379445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 948/1903] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:39.780962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:39.780962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:39.791770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27df900-89ed-4a41-a1d7-bf7c2b1aa0dd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:39.796401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:39.797251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:39.797617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:39.797801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] PATH_INFO: `/v3/projects/a1a1bc4fb6b04667b7e8eadefb8b5279` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:39.799821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a1bc4fb6b04667b7e8eadefb8b5279)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:39.801996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:39.943889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a1bc4fb6b04667b7e8eadefb8b5279', 'request_id': 'req-5982f5a4-602a-454f-8041-e1f59960fe0a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:39.953712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a1bc4fb6b04667b7e8eadefb8b5279', 'request_id': 'req-5982f5a4-602a-454f-8041-e1f59960fe0a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.060246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a1bc4fb6b04667b7e8eadefb8b5279', 'request_id': 'req-5982f5a4-602a-454f-8041-e1f59960fe0a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.072305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] The token cache is being invalidate because project a1a1bc4fb6b04667b7e8eadefb8b5279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:40.072596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.073414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.075051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 956/1904] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:39 2021] DELETE /identity/v3/projects/a1a1bc4fb6b04667b7e8eadefb8b5279 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:40.079088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:40.088820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a307df-fc9b-4c59-a7d2-f93ff0799d0c service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:40.159878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:40.160664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:40.160943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:40.161216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] PATH_INFO: `/v3/users/825bd7aa407c4f1ab7ac9d1a127ffb04` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:40.162451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=825bd7aa407c4f1ab7ac9d1a127ffb04)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:40.164349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:40.367110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825bd7aa407c4f1ab7ac9d1a127ffb04'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.367939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825bd7aa407c4f1ab7ac9d1a127ffb04'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.381754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825bd7aa407c4f1ab7ac9d1a127ffb04'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.382360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825bd7aa407c4f1ab7ac9d1a127ffb04'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.465615 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825bd7aa407c4f1ab7ac9d1a127ffb04'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:40.478437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 949/1905] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:40 2021] DELETE /identity/v3/users/825bd7aa407c4f1ab7ac9d1a127ffb04 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:40.852723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:40.854273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:40.866866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f5a4-602a-454f-8041-e1f59960fe0a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:40.922725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:40.923582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:40.924192 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:40.924487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] PATH_INFO: `/v3/projects/1a817bfb82a34e829921a9860c84d3e0` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:40.925783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a817bfb82a34e829921a9860c84d3e0)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:40.927744 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:41.018883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a817bfb82a34e829921a9860c84d3e0', 'request_id': 'req-ac48980a-31be-45d3-9070-28b5a9cf09e5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.025599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a817bfb82a34e829921a9860c84d3e0', 'request_id': 'req-ac48980a-31be-45d3-9070-28b5a9cf09e5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.083039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a817bfb82a34e829921a9860c84d3e0', 'request_id': 'req-ac48980a-31be-45d3-9070-28b5a9cf09e5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.093893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] The token cache is being invalidate because project 1a817bfb82a34e829921a9860c84d3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:41.094206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.094854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.096682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 957/1906] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:40 2021] DELETE /identity/v3/projects/1a817bfb82a34e829921a9860c84d3e0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:41.100749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:41.102301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:41.116020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aecbc2-e319-4723-a209-efdeb22bd89e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:41.176299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:41.177135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:41.177420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:41.177699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] PATH_INFO: `/v3/users/988637bd1b0a4bc58452471fedacc2bc` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:41.178922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=988637bd1b0a4bc58452471fedacc2bc)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:41.180850 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:41.372278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988637bd1b0a4bc58452471fedacc2bc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.373328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988637bd1b0a4bc58452471fedacc2bc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.386772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988637bd1b0a4bc58452471fedacc2bc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.387446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988637bd1b0a4bc58452471fedacc2bc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.457491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-515a8f9c-acc9-49c3-9226-f5b9f20e1e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988637bd1b0a4bc58452471fedacc2bc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:41.470070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 950/1907] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:41 2021] DELETE /identity/v3/users/988637bd1b0a4bc58452471fedacc2bc => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:41.885576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:41.887074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:41.901093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48980a-31be-45d3-9070-28b5a9cf09e5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:41.981369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:41.982271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:41.982595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:41.982595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] PATH_INFO: `/v3/projects/07c8d5d8ce154178ba6e457e32daf5c1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:41.984604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c8d5d8ce154178ba6e457e32daf5c1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:41.987325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.083420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c8d5d8ce154178ba6e457e32daf5c1', 'request_id': 'req-c11f67cc-305a-416c-b2a8-1bdb91452d8c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:42.089708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c8d5d8ce154178ba6e457e32daf5c1', 'request_id': 'req-c11f67cc-305a-416c-b2a8-1bdb91452d8c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:42.131810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c8d5d8ce154178ba6e457e32daf5c1', 'request_id': 'req-c11f67cc-305a-416c-b2a8-1bdb91452d8c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:42.143581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] The token cache is being invalidate because project 07c8d5d8ce154178ba6e457e32daf5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:42.143795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:42.144447 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c11f67cc-305a-416c-b2a8-1bdb91452d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:42.146022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 958/1908] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:41 2021] DELETE /identity/v3/projects/07c8d5d8ce154178ba6e457e32daf5c1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:42.152969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f07c4-91bb-4c35-8e27-6e9675724325 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.153503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f07c4-91bb-4c35-8e27-6e9675724325 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.153503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f07c4-91bb-4c35-8e27-6e9675724325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.171930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-300f07c4-91bb-4c35-8e27-6e9675724325 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:42.173118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-300f07c4-91bb-4c35-8e27-6e9675724325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:42.251063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 951/1909] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:42.255965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b248b-aa8c-40ab-babd-fa58a9058c84 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.256436 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b248b-aa8c-40ab-babd-fa58a9058c84 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.256818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b248b-aa8c-40ab-babd-fa58a9058c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.280963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-877b248b-aa8c-40ab-babd-fa58a9058c84 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:42.282845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-877b248b-aa8c-40ab-babd-fa58a9058c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:42.292459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 959/1910] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:42.296804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f07c4-91bb-4c35-8e27-6e9675724325 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:42.308653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f07c4-91bb-4c35-8e27-6e9675724325 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:42.313550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:42.314451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.315315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.315623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.316402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:42.316708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:42.318335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.330823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 952/1911] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:34:42.335473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b248b-aa8c-40ab-babd-fa58a9058c84 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:42.347884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b248b-aa8c-40ab-babd-fa58a9058c84 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:42.355233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:42.355923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.356204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.356505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.357256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:42.359226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.438326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 960/1912] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:42 2021] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:42.438916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:42.445489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c874f4a-d916-4361-8c61-53734e720f0a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:42.524732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:42.525409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.525694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.525973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.526755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:42.529168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.605954 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 953/1913] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:42 2021] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:42.612589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:42.625157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100956a-28aa-4e99-a710-ec58dc05ab59 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:42.632101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:42.632784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.633097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.633380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.634167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:42.635829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.649165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 961/1914] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:34:42.653614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:42.665572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34828c45-26d1-4798-8ce9-b9e8f16c6f2b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:42.670094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5775073-858b-4d70-b652-da904aa10aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:42.670786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775073-858b-4d70-b652-da904aa10aea admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.671072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775073-858b-4d70-b652-da904aa10aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.671347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775073-858b-4d70-b652-da904aa10aea admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.672113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5775073-858b-4d70-b652-da904aa10aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:42.674690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5775073-858b-4d70-b652-da904aa10aea admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.684953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 954/1915] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:42.689073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:42.698882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d80516-e9de-4a1f-8710-d54f98cf86b8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:42.703388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:42.704250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.704531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.704803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] PATH_INFO: `/v3/projects/a80f23f1f7e54d86a73be3c20979581b/users/aa2ff7cc84b44ea688c3a55ca4989ce0/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.719124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80f23f1f7e54d86a73be3c20979581b, user_id=aa2ff7cc84b44ea688c3a55ca4989ce0, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:42.722630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.797089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 962/1916] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:42 2021] PUT /identity/v3/projects/a80f23f1f7e54d86a73be3c20979581b/users/aa2ff7cc84b44ea688c3a55ca4989ce0/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:42.808908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b857ba-66b0-4f88-a419-ab702bb52dec None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.809193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b857ba-66b0-4f88-a419-ab702bb52dec None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.809465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b857ba-66b0-4f88-a419-ab702bb52dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.835780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c6b857ba-66b0-4f88-a419-ab702bb52dec None None] MFA Rules not processed for user `aa2ff7cc84b44ea688c3a55ca4989ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:42.837031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c6b857ba-66b0-4f88-a419-ab702bb52dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:42.901746 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 955/1917] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:42 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:42.914012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:42.915764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:42.972222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720b1ca-c27e-4c6c-ac05-1939245a83e2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:42.975937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:42.976612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:42.976892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:42.977170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:42.985449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:42.986944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:42.995875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 963/1918] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:42 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:49.995503 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26e65-aa77-4c2b-97dc-bfa75140e6cf None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:49.996101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26e65-aa77-4c2b-97dc-bfa75140e6cf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:49.996101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c26e65-aa77-4c2b-97dc-bfa75140e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:50.014120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-53c26e65-aa77-4c2b-97dc-bfa75140e6cf None None] MFA Rules not processed for user `01987e7fb04b44bcbe2c57f635fb5e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:50.015347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-53c26e65-aa77-4c2b-97dc-bfa75140e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:50.070357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 956/1919] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:49 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:53.116486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:53.117923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:53.186478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a24370-bb11-499f-a51c-7ca15519de73 service glance] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:53.191360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:53.192228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:53.192516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:53.192797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] PATH_INFO: `/v3/users/ed244a739a744b67a1e3ab9a139b2593` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:53.194017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed244a739a744b67a1e3ab9a139b2593)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:53.196084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:53.377980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed244a739a744b67a1e3ab9a139b2593'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:53.389485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed244a739a744b67a1e3ab9a139b2593'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:53.390147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed244a739a744b67a1e3ab9a139b2593'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:53.390792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed244a739a744b67a1e3ab9a139b2593'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:53.398504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed244a739a744b67a1e3ab9a139b2593'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:53.485210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 964/1920] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:53 2021] DELETE /identity/v3/users/ed244a739a744b67a1e3ab9a139b2593 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:53.490291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:53.490813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:53.490912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:53.511325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:53.512782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:53.582925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 957/1921] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:53.595377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:53.597530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:53.653827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ef19-47ba-4a90-89f5-376489a5eac6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:53.657486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:53.658713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:53.658995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:53.659315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:53.668256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:53.669790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:53.679758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 965/1922] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:54.154077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:54.155551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:54.169649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b497-5cfd-4767-a0b2-dfa878e449f8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:54.175638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:54.176760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:54.177247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:54.177666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] PATH_INFO: `/v3/projects/28911cb1285940268adb7f8d3a27ba5f` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:54.179364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28911cb1285940268adb7f8d3a27ba5f)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:54.181796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:54.351659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28911cb1285940268adb7f8d3a27ba5f', 'request_id': 'req-1941f36c-cd61-43c6-86b0-c42321424012'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.356974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28911cb1285940268adb7f8d3a27ba5f', 'request_id': 'req-1941f36c-cd61-43c6-86b0-c42321424012'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.431453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28911cb1285940268adb7f8d3a27ba5f', 'request_id': 'req-1941f36c-cd61-43c6-86b0-c42321424012'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.442786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] The token cache is being invalidate because project 28911cb1285940268adb7f8d3a27ba5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:54.443072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.444317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.445218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 958/1923] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:54 2021] DELETE /identity/v3/projects/28911cb1285940268adb7f8d3a27ba5f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:54.449190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:54.459259 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c759556-21df-43d7-bcb9-d15e249d0a4c service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:54.515547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:54.516440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:54.516987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:54.517333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] PATH_INFO: `/v3/users/23a56bfc6961471eaf8a4c22dbfc422b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:54.518938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a56bfc6961471eaf8a4c22dbfc422b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:54.521015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:54.761664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a56bfc6961471eaf8a4c22dbfc422b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.775060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a56bfc6961471eaf8a4c22dbfc422b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.775780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a56bfc6961471eaf8a4c22dbfc422b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.776403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a56bfc6961471eaf8a4c22dbfc422b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.784648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f302572-b9b0-404f-8e25-2eca5f3581cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a56bfc6961471eaf8a4c22dbfc422b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:54.902964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 966/1924] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:54 2021] DELETE /identity/v3/users/23a56bfc6961471eaf8a4c22dbfc422b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:55.493124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:55.493124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:55.505859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941f36c-cd61-43c6-86b0-c42321424012 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:55.626322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:55.628444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:55.628949 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:55.629550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] PATH_INFO: `/v3/projects/2304dc4353bf45f69d83ec643b2f63aa` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:55.631190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2304dc4353bf45f69d83ec643b2f63aa)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:55.642604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:55.879139 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2304dc4353bf45f69d83ec643b2f63aa', 'request_id': 'req-035d9950-234e-40c1-95b8-f74a4ff0f14c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:55.886311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2304dc4353bf45f69d83ec643b2f63aa', 'request_id': 'req-035d9950-234e-40c1-95b8-f74a4ff0f14c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.014491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2304dc4353bf45f69d83ec643b2f63aa', 'request_id': 'req-035d9950-234e-40c1-95b8-f74a4ff0f14c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.028542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] The token cache is being invalidate because project 2304dc4353bf45f69d83ec643b2f63aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:56.028921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.029642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-035d9950-234e-40c1-95b8-f74a4ff0f14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.031213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 959/1925] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:55 2021] DELETE /identity/v3/projects/2304dc4353bf45f69d83ec643b2f63aa => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:56.037417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b29c-8b25-4b1d-87c7-6d414b564496 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.037908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b29c-8b25-4b1d-87c7-6d414b564496 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.038005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64b29c-8b25-4b1d-87c7-6d414b564496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.066864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3c64b29c-8b25-4b1d-87c7-6d414b564496 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:56.068323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3c64b29c-8b25-4b1d-87c7-6d414b564496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:56.144210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 967/1926] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:56.151052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5b18-8a84-41b7-8591-dc5428939d8c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.151347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5b18-8a84-41b7-8591-dc5428939d8c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.151629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5b18-8a84-41b7-8591-dc5428939d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.172334 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-503b5b18-8a84-41b7-8591-dc5428939d8c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:56.173454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-503b5b18-8a84-41b7-8591-dc5428939d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:56.181611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 960/1927] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:56.185904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b29c-8b25-4b1d-87c7-6d414b564496 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.196533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64b29c-8b25-4b1d-87c7-6d414b564496 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.201971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.203563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.203563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.203563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.204007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:56.204387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.206915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.219554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 968/1928] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:34:56.223643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b5b18-8a84-41b7-8591-dc5428939d8c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.232884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b5b18-8a84-41b7-8591-dc5428939d8c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.238321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.238970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.239255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.239532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.240250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.242238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.329540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 961/1929] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:56 2021] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:34:56.332145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.344772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4a132-82ee-4493-94a9-d4a474139bff admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.407812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.409053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.409345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.409621 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.410369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.412292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.496667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.500374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:56.508864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 969/1930] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:56 2021] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:56.512371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.518577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d141d-4bea-4cc1-8c0d-b4754c17f035 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.523798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.524548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181382f8-52ee-4b52-81ce-465719ae319b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.525053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.525343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.525629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] PATH_INFO: `/v3/users/a0f4c53292cd456ea5596a97e5812764` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.526890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f4c53292cd456ea5596a97e5812764)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.528801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.534251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.534251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.534251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.534251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.534611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.535922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.550044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 970/1931] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:56 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:34:56.551898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.567311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0a010-2aed-403a-b03e-ecaa4fd8a962 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.572441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.573145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.573437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.573706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.574485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.576068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.587288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 971/1932] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:56 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:56.591346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.603313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a819093-d0c4-4086-bb62-8a1ad481c830 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.608596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.609493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.609776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.610099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] PATH_INFO: `/v3/projects/561f4ed43b404ba18cc35ae9d83e58d1/users/b40f791d66bf472aae8c9aac92d58a57/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.629511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561f4ed43b404ba18cc35ae9d83e58d1, user_id=b40f791d66bf472aae8c9aac92d58a57, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.632300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.724109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 972/1933] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:56 2021] PUT /identity/v3/projects/561f4ed43b404ba18cc35ae9d83e58d1/users/b40f791d66bf472aae8c9aac92d58a57/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:56.724109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:56.729784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:56.739369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f4c53292cd456ea5596a97e5812764'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.740601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f4c53292cd456ea5596a97e5812764'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.755639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f4c53292cd456ea5596a97e5812764'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.756352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f4c53292cd456ea5596a97e5812764'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.802341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb2e9-24b7-4ed8-b09e-c0f255ce59d9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:56.807392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:56.808275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.808724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.809013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] PATH_INFO: `/v3/users/216fbdbffa044efe905be6d19d11064e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.810590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=216fbdbffa044efe905be6d19d11064e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:56.812466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:56.868977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-65a2962d-286c-447b-b7a1-c8fa71328885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f4c53292cd456ea5596a97e5812764'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:56.883913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 962/1934] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:56 2021] DELETE /identity/v3/users/a0f4c53292cd456ea5596a97e5812764 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:56.894299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d197d-586a-4f37-aad8-aebe16132c2b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:56.894972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d197d-586a-4f37-aad8-aebe16132c2b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:56.895418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d197d-586a-4f37-aad8-aebe16132c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:56.933629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-487d197d-586a-4f37-aad8-aebe16132c2b None None] MFA Rules not processed for user `b40f791d66bf472aae8c9aac92d58a57`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:56.934887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-487d197d-586a-4f37-aad8-aebe16132c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.002772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 963/1935] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:56 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:57.004523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.004523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.004722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.022580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:57.023772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.063178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216fbdbffa044efe905be6d19d11064e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.077493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216fbdbffa044efe905be6d19d11064e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.078256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216fbdbffa044efe905be6d19d11064e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.078848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216fbdbffa044efe905be6d19d11064e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.085288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 964/1936] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:57.086540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216fbdbffa044efe905be6d19d11064e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.089250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.090904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.102789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed2c0c-e272-4580-97d9-5cc9d6604309 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.107986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.108724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.109019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.109304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.110015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.112504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.188402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 973/1937] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:56 2021] DELETE /identity/v3/users/216fbdbffa044efe905be6d19d11064e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:57.190297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.200237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.260265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 965/1938] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:57 2021] POST /identity/v3/projects => generated 363 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:57.261254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.270841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd405-05a1-44ec-b486-3df2f8fc4951 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.322302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.323774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.324279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.324732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.327977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0414aa-6133-4aa5-87bd-ee0db85659a7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.333541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.334243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.334524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.334797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.335512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.336113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.337426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.337914 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.348743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 974/1939] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:57.431724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 966/1940] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:57 2021] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:57.435473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.446674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd763-af7c-4b74-bc7e-8e5e8d901d2a service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.459836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.460004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.460580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.460868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.461359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.462205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.463948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.464365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.478333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0170965-1129-4f1e-894c-cdee3a6ff2ca admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.482340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 975/1941] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:57 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:57.483465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.484356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.484651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.484934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] PATH_INFO: `/v3/projects/e3792278fa6347cdafac78bd8c96f4be` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.489998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3792278fa6347cdafac78bd8c96f4be)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.491974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.493334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.505329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362404dd-6c80-43cb-a902-fabd5c411534 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.510456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.511414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.511632 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.511912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] PATH_INFO: `/v3/projects/82cf49c71adf494ba60637feae57b703/users/8533c3d2b3f84b86bf7a8b9a207e5424/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.528867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cf49c71adf494ba60637feae57b703, user_id=8533c3d2b3f84b86bf7a8b9a207e5424, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.531729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.604349 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 976/1942] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:57 2021] PUT /identity/v3/projects/82cf49c71adf494ba60637feae57b703/users/8533c3d2b3f84b86bf7a8b9a207e5424/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:57.608812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.619617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3792278fa6347cdafac78bd8c96f4be', 'request_id': 'req-103566b6-2ff4-4005-a185-bdec52001e14'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.631917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3792278fa6347cdafac78bd8c96f4be', 'request_id': 'req-103566b6-2ff4-4005-a185-bdec52001e14'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.673908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eacab-b7f3-4a9d-a83b-db3ba3408011 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.708825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3792278fa6347cdafac78bd8c96f4be', 'request_id': 'req-103566b6-2ff4-4005-a185-bdec52001e14'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.721721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] The token cache is being invalidate because project e3792278fa6347cdafac78bd8c96f4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:57.722056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.722743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-103566b6-2ff4-4005-a185-bdec52001e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:57.725395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 967/1943] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:57 2021] DELETE /identity/v3/projects/e3792278fa6347cdafac78bd8c96f4be => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:57.730818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0331f3-bf41-43dd-ac3e-53d3e67d0115 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.731109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0331f3-bf41-43dd-ac3e-53d3e67d0115 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.731392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0331f3-bf41-43dd-ac3e-53d3e67d0115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.752478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0c0331f3-bf41-43dd-ac3e-53d3e67d0115 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:57.753206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0c0331f3-bf41-43dd-ac3e-53d3e67d0115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.761674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.762398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.762766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.762950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.763769 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.765579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.766218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 968/1944] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:34:57.774856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4906cb-9b51-441f-aab4-04316cc31b9a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.775180 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4906cb-9b51-441f-aab4-04316cc31b9a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.775535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4906cb-9b51-441f-aab4-04316cc31b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.777585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 977/1945] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:57 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:57.786838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.786838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.809355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb3745-3dbf-4667-b19c-968427b331c1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.816042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0a4906cb-9b51-441f-aab4-04316cc31b9a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:57.817549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0a4906cb-9b51-441f-aab4-04316cc31b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.818105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.819125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.819475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.819846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] PATH_INFO: `/v3/projects/82cf49c71adf494ba60637feae57b703/users/8533c3d2b3f84b86bf7a8b9a207e5424/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.822303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cf49c71adf494ba60637feae57b703, user_id=8533c3d2b3f84b86bf7a8b9a207e5424, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.824949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.827059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 969/1946] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:57.831282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4906cb-9b51-441f-aab4-04316cc31b9a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.837674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 978/1947] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:57 2021] PUT /identity/v3/projects/82cf49c71adf494ba60637feae57b703/users/8533c3d2b3f84b86bf7a8b9a207e5424/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:57.851729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:57.853541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:57.853991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4906cb-9b51-441f-aab4-04316cc31b9a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.917617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6972bf6-bf95-4aa6-9e75-0bf780fa2877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.918332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972bf6-bf95-4aa6-9e75-0bf780fa2877 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.918598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972bf6-bf95-4aa6-9e75-0bf780fa2877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.918876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6972bf6-bf95-4aa6-9e75-0bf780fa2877 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.919616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6972bf6-bf95-4aa6-9e75-0bf780fa2877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:57.919921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6972bf6-bf95-4aa6-9e75-0bf780fa2877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.921528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6972bf6-bf95-4aa6-9e75-0bf780fa2877 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.925291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8112b-6ca1-4962-ae6b-55f2f3a15c80 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:57.937233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:57.937233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.937233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.937233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] PATH_INFO: `/v3/projects/1d082c8fe5b44353b0a5d447056451da` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.937610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d082c8fe5b44353b0a5d447056451da)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:57.937702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 970/1948] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:34:57.937796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:57.937879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f84bc-71d4-478d-8ecb-def2d4892087 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:57.937879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f84bc-71d4-478d-8ecb-def2d4892087 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:57.937879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f84bc-71d4-478d-8ecb-def2d4892087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:57.968235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-057f84bc-71d4-478d-8ecb-def2d4892087 None None] MFA Rules not processed for user `8533c3d2b3f84b86bf7a8b9a207e5424`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:57.969455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-057f84bc-71d4-478d-8ecb-def2d4892087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.041715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 971/1949] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:57 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:58.042505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f84bc-71d4-478d-8ecb-def2d4892087 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.053684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f84bc-71d4-478d-8ecb-def2d4892087 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.060046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.060415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.060711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.060980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.061830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.063803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.073035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d082c8fe5b44353b0a5d447056451da', 'request_id': 'req-332e5e07-0458-4930-94c6-8969b2011045'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.081612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d082c8fe5b44353b0a5d447056451da', 'request_id': 'req-332e5e07-0458-4930-94c6-8969b2011045'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.150407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 972/1950] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:58 2021] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:58.151241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.152998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.171262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d082c8fe5b44353b0a5d447056451da', 'request_id': 'req-332e5e07-0458-4930-94c6-8969b2011045'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.182827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] The token cache is being invalidate because project 1d082c8fe5b44353b0a5d447056451da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:58.183122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.189535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.189535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 979/1951] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:57 2021] DELETE /identity/v3/projects/1d082c8fe5b44353b0a5d447056451da => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:58.189535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.189535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.211017 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd4db-419a-4e89-b0ad-cb9ce6efef2a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.214800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.215586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.215722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.216001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.218076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.255206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e5e07-0458-4930-94c6-8969b2011045 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.283971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.285418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.295059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 973/1952] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:58 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:58.295876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.297257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.311146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.312193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.312193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.312588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.313499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.316036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.363928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08931-eaae-4902-aefc-83bf49f99006 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.368878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.369741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.370026 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.370365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] PATH_INFO: `/v3/users/3e15268b7ad24c76a165c76ae2bebcac` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.376248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e15268b7ad24c76a165c76ae2bebcac)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.376248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.401485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 980/1953] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:58 2021] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:58.402678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.412749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5c04-e1b9-45e5-9bda-916f87587093 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.417543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.418293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.418588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.418895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.419683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.421305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.432234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 981/1954] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:34:58.436915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.447675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d8060-ef0d-48cb-ae0e-a3f9a72eb7fc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.452424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.453084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.453368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.453642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.454415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.456924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.466684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 982/1955] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:34:58.471798 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.481104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9bc1-0805-476d-8e49-31574eb21ba8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.485719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.487079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.487361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.487638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] PATH_INFO: `/v3/projects/633050a6960549ecb11c43df14b40b56/users/e693678cc9684948a1c5b976e198b93c/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.506105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=633050a6960549ecb11c43df14b40b56, user_id=e693678cc9684948a1c5b976e198b93c, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.506780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.537104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e15268b7ad24c76a165c76ae2bebcac'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.537828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e15268b7ad24c76a165c76ae2bebcac'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.550358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e15268b7ad24c76a165c76ae2bebcac'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.550991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e15268b7ad24c76a165c76ae2bebcac'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.584232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 983/1956] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:34:58 2021] PUT /identity/v3/projects/633050a6960549ecb11c43df14b40b56/users/e693678cc9684948a1c5b976e198b93c/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:58.585058 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.587471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.643973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f13e6d31-56ba-4467-98a6-1409f2b1812c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e15268b7ad24c76a165c76ae2bebcac'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:58.651013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee458-f49b-4fe4-90aa-f87d07fb5b8b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.654930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.655583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.655856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.656130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.657934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 974/1957] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:34:58 2021] DELETE /identity/v3/users/3e15268b7ad24c76a165c76ae2bebcac => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:34:58.658104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.660883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.661386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.661876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.692311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] MFA Rules not processed for user `e693678cc9684948a1c5b976e198b93c`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:58.693527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.723434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.725155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.735470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 984/1958] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:58 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:58.770225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 975/1959] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:58.778992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:58.780557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:58.855216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ffa38-e6d8-4c56-aac6-e773a9695547 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:58.934758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b73131-3cf3-42e8-8779-552cfc5736fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:58.935564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73131-3cf3-42e8-8779-552cfc5736fd service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:58.935933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73131-3cf3-42e8-8779-552cfc5736fd service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:58.936165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73131-3cf3-42e8-8779-552cfc5736fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:58.946095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b73131-3cf3-42e8-8779-552cfc5736fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:58.947746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b73131-3cf3-42e8-8779-552cfc5736fd service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:58.958402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 985/1960] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:34:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:34:59.208751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:59.210241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:59.279085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b631375-0f63-4a0b-beb5-db60efc69a2c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:59.284130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:59.285065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:59.285346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:59.285624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] PATH_INFO: `/v3/projects/9ee6c73ad05246fd9c7670f7d1c6811d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:59.286840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee6c73ad05246fd9c7670f7d1c6811d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:59.288754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:59.441052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee6c73ad05246fd9c7670f7d1c6811d', 'request_id': 'req-6134e52b-566e-4013-85a6-a7c5d1680660'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:59.446306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee6c73ad05246fd9c7670f7d1c6811d', 'request_id': 'req-6134e52b-566e-4013-85a6-a7c5d1680660'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:59.518255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee6c73ad05246fd9c7670f7d1c6811d', 'request_id': 'req-6134e52b-566e-4013-85a6-a7c5d1680660'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:59.530011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] The token cache is being invalidate because project 9ee6c73ad05246fd9c7670f7d1c6811d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:34:59.530331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:59.530957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6134e52b-566e-4013-85a6-a7c5d1680660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:34:59.532517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 976/1961] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:34:59 2021] DELETE /identity/v3/projects/9ee6c73ad05246fd9c7670f7d1c6811d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:34:59.541253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8bafe-fa87-4d25-846d-652b9a006a13 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:59.541644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8bafe-fa87-4d25-846d-652b9a006a13 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:59.541810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8bafe-fa87-4d25-846d-652b9a006a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:59.560334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5ad8bafe-fa87-4d25-846d-652b9a006a13 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:59.561580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5ad8bafe-fa87-4d25-846d-652b9a006a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:59.619076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 986/1962] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:59.660758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f798db-d4f6-4a9e-8fa2-d4235cc1a7f8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:59.661289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f798db-d4f6-4a9e-8fa2-d4235cc1a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:59.661289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f798db-d4f6-4a9e-8fa2-d4235cc1a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:59.679990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-17f798db-d4f6-4a9e-8fa2-d4235cc1a7f8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:34:59.681206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-17f798db-d4f6-4a9e-8fa2-d4235cc1a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:34:59.688993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 977/1963] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:34:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:34:59.693161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8bafe-fa87-4d25-846d-652b9a006a13 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:59.703047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8bafe-fa87-4d25-846d-652b9a006a13 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:59.707846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:59.708501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:59.708786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:59.709063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:59.709803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:34:59.710113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:59.711733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:59.724484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 987/1964] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:34:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:34:59.728812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f798db-d4f6-4a9e-8fa2-d4235cc1a7f8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:59.738750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f798db-d4f6-4a9e-8fa2-d4235cc1a7f8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:59.743400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:59.744051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:59.744334 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:59.744604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:59.745317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:59.747324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:34:59.866837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 978/1965] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:34:59 2021] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:34:59.868012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:34:59.881544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efaa9b-0ac4-48bd-a24e-05aa6969118f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:34:59.948905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:34:59.949790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:34:59.950009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:34:59.950327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:34:59.950988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:34:59.952947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.055430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 988/1966] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:34:59 2021] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:00.061469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.077314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6253ec-9c52-4c68-bb2a-9eeaf48c948a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.082250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.082920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.083203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.083487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.084231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.085859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.101272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 979/1967] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:00.103241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.115223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf44851-49cd-45ac-b8b6-a2b06926875f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.122900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed49958-fd2c-4b20-a5bc-8be51a3a7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.123856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed49958-fd2c-4b20-a5bc-8be51a3a7c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.124592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed49958-fd2c-4b20-a5bc-8be51a3a7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.131132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed49958-fd2c-4b20-a5bc-8be51a3a7c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.131132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed49958-fd2c-4b20-a5bc-8be51a3a7c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.131132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed49958-fd2c-4b20-a5bc-8be51a3a7c2a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.142898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 989/1968] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:00.150004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.170571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215908d-9078-4714-88c4-903836951b49 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.176802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.177773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.178083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.178486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] PATH_INFO: `/v3/projects/7c7427e2d66f4ddba9b4ddfccde9c8c6/users/35cebe7e2f74400f80d0148c9ad82aff/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.194393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7427e2d66f4ddba9b4ddfccde9c8c6, user_id=35cebe7e2f74400f80d0148c9ad82aff, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.197024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.255323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 980/1969] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:00 2021] PUT /identity/v3/projects/7c7427e2d66f4ddba9b4ddfccde9c8c6/users/35cebe7e2f74400f80d0148c9ad82aff/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:00.265718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8ef59-ab41-49e0-916f-7afeb5a038d4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.266867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8ef59-ab41-49e0-916f-7afeb5a038d4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.267296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8ef59-ab41-49e0-916f-7afeb5a038d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.295642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ecf8ef59-ab41-49e0-916f-7afeb5a038d4 None None] MFA Rules not processed for user `35cebe7e2f74400f80d0148c9ad82aff`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:00.296769 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ecf8ef59-ab41-49e0-916f-7afeb5a038d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:00.373442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 990/1970] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:00.378051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.450083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c2b7e-8075-45d2-b8fd-93f413468c03 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.455563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.456247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.456558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.456811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.457534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.459515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.576067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 981/1971] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:00 2021] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:00.581415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8ef59-ab41-49e0-916f-7afeb5a038d4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.592033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8ef59-ab41-49e0-916f-7afeb5a038d4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.653257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.653965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.654304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.654580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.655291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.657191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.741535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 991/1972] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:00 2021] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:00.742430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.754133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b8811-6c29-4d2b-8d6c-85dcd36c450d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.759895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.760772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.761065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.761359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.762350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.764148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.777257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 982/1973] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:00.781399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.793697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4d3f6-d55a-4e82-8ed4-fdcc5c3174b6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.799334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d231b-704a-4a45-9224-d947abc18993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.800115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d231b-704a-4a45-9224-d947abc18993 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.800472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d231b-704a-4a45-9224-d947abc18993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.800820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d231b-704a-4a45-9224-d947abc18993 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.801647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d231b-704a-4a45-9224-d947abc18993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.803460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d231b-704a-4a45-9224-d947abc18993 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.815678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 992/1974] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:00.820155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:00.831856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02cf22-8b43-4d2f-b62f-90e2ff4a3db7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:00.837348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:00.838321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.838607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.841237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] PATH_INFO: `/v3/projects/b3db4004c465457fbe0bcd475822cc87/users/b42b4bfa80a84edeb3f312cbb60f169d/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:00.855003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3db4004c465457fbe0bcd475822cc87, user_id=b42b4bfa80a84edeb3f312cbb60f169d, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:00.857789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:00.977355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 983/1975] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:00 2021] PUT /identity/v3/projects/b3db4004c465457fbe0bcd475822cc87/users/b42b4bfa80a84edeb3f312cbb60f169d/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:00.997919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9076-7cf6-4f2a-a480-530d39a8373d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:00.998620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9076-7cf6-4f2a-a480-530d39a8373d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:00.998924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9076-7cf6-4f2a-a480-530d39a8373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.057210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-79ab9076-7cf6-4f2a-a480-530d39a8373d None None] MFA Rules not processed for user `b42b4bfa80a84edeb3f312cbb60f169d`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:01.057210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-79ab9076-7cf6-4f2a-a480-530d39a8373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:01.152495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 993/1976] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:00 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:01.156985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:01.247160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116eb95-be08-4f85-ad06-c5b276c51bc5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:01.252228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:01.252968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:01.253414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:01.253843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.254855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:01.256956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:01.338727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 984/1977] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:01 2021] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:01.342781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9076-7cf6-4f2a-a480-530d39a8373d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:01.354032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9076-7cf6-4f2a-a480-530d39a8373d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:01.425947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:01.426701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:01.426988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:01.427267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.427996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:01.429979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:01.526644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 994/1978] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:01 2021] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:01.530664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:01.544474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff194ce-127e-413a-aeb6-e0edd2d61be4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:01.549867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:01.550569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:01.555646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:01.555646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.555646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:01.555646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:01.565279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 985/1979] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:01 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:01.569506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:01.581546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ecb44-7553-479e-a584-4785f217fdb9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:01.586542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:01.587453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:01.587738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:01.588018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] PATH_INFO: `/v3/projects/8bcb24e6d32b493b959b175df964ab68/users/a89ab6b96a5a4f93a80bdda4867c6477/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.608870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcb24e6d32b493b959b175df964ab68, user_id=a89ab6b96a5a4f93a80bdda4867c6477, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:01.612090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:01.721101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 995/1980] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:01 2021] PUT /identity/v3/projects/8bcb24e6d32b493b959b175df964ab68/users/a89ab6b96a5a4f93a80bdda4867c6477/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:01.727860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:01.737774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148138de-169b-4e9c-99af-f02132fc49e4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:01.799583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274c132-1c5f-4b40-bdfd-d098726bace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:01.800301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274c132-1c5f-4b40-bdfd-d098726bace3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:01.800797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274c132-1c5f-4b40-bdfd-d098726bace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:01.802352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274c132-1c5f-4b40-bdfd-d098726bace3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.802352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274c132-1c5f-4b40-bdfd-d098726bace3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:01.803506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274c132-1c5f-4b40-bdfd-d098726bace3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:01.817684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 986/1981] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:01 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:01.818828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:01.830592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696408-1e8b-4c35-83af-ff6703cf00a0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:01.835870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:01.836760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:01.837043 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:01.837322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] PATH_INFO: `/v3/projects/8bcb24e6d32b493b959b175df964ab68/users/a89ab6b96a5a4f93a80bdda4867c6477/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.839371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcb24e6d32b493b959b175df964ab68, user_id=a89ab6b96a5a4f93a80bdda4867c6477, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:01.842048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:01.853643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 996/1982] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:01 2021] PUT /identity/v3/projects/8bcb24e6d32b493b959b175df964ab68/users/a89ab6b96a5a4f93a80bdda4867c6477/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:01.865113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:01.865452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:01.865749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:01.895378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] MFA Rules not processed for user `a89ab6b96a5a4f93a80bdda4867c6477`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:01.896605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:01.964146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 987/1983] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:01 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:01.974889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:01.976688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:02.039986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b230b83-8e52-4afb-b741-b58333ee1abd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:02.043672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:02.044314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:02.044602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:02.044883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:02.053882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:02.055427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:02.065394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 997/1984] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:01 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:02.175568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:02.176980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:02.188581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e74e0-6b4e-402d-9d5f-5e0998f0822b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:02.193062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638d0df-1a8a-49e2-bdad-0853bf935383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:02.193721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638d0df-1a8a-49e2-bdad-0853bf935383 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:02.194193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638d0df-1a8a-49e2-bdad-0853bf935383 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:02.194563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638d0df-1a8a-49e2-bdad-0853bf935383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:02.257223 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638d0df-1a8a-49e2-bdad-0853bf935383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:02.262136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638d0df-1a8a-49e2-bdad-0853bf935383 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:02.268584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 988/1985] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:02 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:02.474750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:02.476260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:02.542011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4b73f-bef8-4f9f-8dd6-7ff6b88cf177 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:02.546697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:02.547589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:02.547875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:02.548152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] PATH_INFO: `/v3/users/b40f791d66bf472aae8c9aac92d58a57` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:02.549962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40f791d66bf472aae8c9aac92d58a57)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:02.551915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:02.721435 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40f791d66bf472aae8c9aac92d58a57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:02.739742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40f791d66bf472aae8c9aac92d58a57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:02.739742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40f791d66bf472aae8c9aac92d58a57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:02.739742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40f791d66bf472aae8c9aac92d58a57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:02.742876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40f791d66bf472aae8c9aac92d58a57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:02.813785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 998/1986] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:02 2021] DELETE /identity/v3/users/b40f791d66bf472aae8c9aac92d58a57 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:02.818902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:02.819377 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:02.819469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:02.837056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:02.838309 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:02.911297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 989/1987] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:02.924712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:02.926395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:02.985789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a451b9-cab5-4ab2-a287-7ea08bdb588f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:02.990197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:02.990871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:02.991159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:02.993804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:03.000393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:03.002455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:03.015305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 999/1988] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:03.428387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:03.429888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:03.441925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fd5fb-e645-45ef-bdbd-e2f57d0657cf None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:03.448068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:03.449345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:03.449824 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:03.450280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] PATH_INFO: `/v3/projects/561f4ed43b404ba18cc35ae9d83e58d1` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:03.452228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561f4ed43b404ba18cc35ae9d83e58d1)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:03.454208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:03.585644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561f4ed43b404ba18cc35ae9d83e58d1', 'request_id': 'req-28ec81f5-74af-4ff9-aee6-3b11342a1169'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.591057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561f4ed43b404ba18cc35ae9d83e58d1', 'request_id': 'req-28ec81f5-74af-4ff9-aee6-3b11342a1169'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.675040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561f4ed43b404ba18cc35ae9d83e58d1', 'request_id': 'req-28ec81f5-74af-4ff9-aee6-3b11342a1169'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.686221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] The token cache is being invalidate because project 561f4ed43b404ba18cc35ae9d83e58d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:03.686515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.687137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.688665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 990/1989] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:03 2021] DELETE /identity/v3/projects/561f4ed43b404ba18cc35ae9d83e58d1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:03.692630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:03.702346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b06b0-da1a-4f5e-bf20-5c4e64e4183e service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:03.755013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:03.755867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:03.756145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:03.756417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] PATH_INFO: `/v3/users/8533c3d2b3f84b86bf7a8b9a207e5424` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:03.757601 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8533c3d2b3f84b86bf7a8b9a207e5424)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:03.759644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:03.951167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8533c3d2b3f84b86bf7a8b9a207e5424'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.962980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8533c3d2b3f84b86bf7a8b9a207e5424'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.963653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8533c3d2b3f84b86bf7a8b9a207e5424'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.964288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8533c3d2b3f84b86bf7a8b9a207e5424'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:03.971750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5ff3ff76-eaff-42b7-80ba-eb99dc1a4f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8533c3d2b3f84b86bf7a8b9a207e5424'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:04.077110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1000/1990] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:03 2021] DELETE /identity/v3/users/8533c3d2b3f84b86bf7a8b9a207e5424 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:04.467137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:04.468569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:04.481834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec81f5-74af-4ff9-aee6-3b11342a1169 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:04.540140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:04.540864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:04.541287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:04.541576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] PATH_INFO: `/v3/projects/82cf49c71adf494ba60637feae57b703` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:04.542830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cf49c71adf494ba60637feae57b703)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:04.544992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:04.649125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cf49c71adf494ba60637feae57b703', 'request_id': 'req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:04.654964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cf49c71adf494ba60637feae57b703', 'request_id': 'req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:04.737514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cf49c71adf494ba60637feae57b703', 'request_id': 'req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:04.749160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] The token cache is being invalidate because project 82cf49c71adf494ba60637feae57b703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:04.749455 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:04.750152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ce5a1fe-b632-461c-8cf5-f4c91735c2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:04.751842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 991/1991] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:04 2021] DELETE /identity/v3/projects/82cf49c71adf494ba60637feae57b703 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:04.759126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c62272-5506-4bea-bf11-306e6a4cbf1f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:04.759620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c62272-5506-4bea-bf11-306e6a4cbf1f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:04.759848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c62272-5506-4bea-bf11-306e6a4cbf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:04.778658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f7c62272-5506-4bea-bf11-306e6a4cbf1f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:04.779845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f7c62272-5506-4bea-bf11-306e6a4cbf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:04.837895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1001/1992] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:04.845939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648673a0-4806-499e-b00e-5abf13449233 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:04.846259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648673a0-4806-499e-b00e-5abf13449233 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:04.846537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648673a0-4806-499e-b00e-5abf13449233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:04.864408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-648673a0-4806-499e-b00e-5abf13449233 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:04.865582 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-648673a0-4806-499e-b00e-5abf13449233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:04.873363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 992/1993] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:04.878209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c62272-5506-4bea-bf11-306e6a4cbf1f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:04.887479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c62272-5506-4bea-bf11-306e6a4cbf1f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:04.893441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:04.894099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:04.894414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:04.894694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:04.895439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:04.895817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:04.897484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:04.908887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1002/1994] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:04.913034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648673a0-4806-499e-b00e-5abf13449233 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:04.922243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648673a0-4806-499e-b00e-5abf13449233 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:04.927451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:04.928089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:04.928371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:04.928651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:04.929386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:04.931311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:05.007986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 993/1995] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:04 2021] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:05.011909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:05.023197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c546295-62e0-48ab-a2d7-c169b5870b29 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:05.077493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:05.078205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:05.078493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:05.078778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:05.079500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:05.082204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:05.166068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1003/1996] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:05 2021] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:05.172260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:05.182740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0a6a4-2102-437c-8f2a-89969c91a4ef admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:05.187406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:05.188062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:05.188348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:05.188628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:05.189890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:05.191630 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:05.201886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 994/1997] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:05.206047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:05.215828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ced30-ec62-4208-a1af-c7e1fcccd743 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:05.220484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ce2dc-4389-4ed2-a523-5d9bd85e5e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:05.221131 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ce2dc-4389-4ed2-a523-5d9bd85e5e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:05.221414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ce2dc-4389-4ed2-a523-5d9bd85e5e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:05.221691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ce2dc-4389-4ed2-a523-5d9bd85e5e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:05.222467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ce2dc-4389-4ed2-a523-5d9bd85e5e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:05.224037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ce2dc-4389-4ed2-a523-5d9bd85e5e82 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:05.233511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1004/1998] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:05 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:05.238235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:05.247798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021138-8137-4b39-a7f9-3daf281dd0b1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:05.253000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:05.253846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:05.254121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:05.254417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] PATH_INFO: `/v3/projects/017e6322cda446d9b3d9b6d1ea7456a3/users/36281a1dd30748ed9dcf631e99ec09f2/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:05.269057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=017e6322cda446d9b3d9b6d1ea7456a3, user_id=36281a1dd30748ed9dcf631e99ec09f2, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:05.271720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:05.362098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 995/1999] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:05 2021] PUT /identity/v3/projects/017e6322cda446d9b3d9b6d1ea7456a3/users/36281a1dd30748ed9dcf631e99ec09f2/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:05.372342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:05.372635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:05.372915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:05.409940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] MFA Rules not processed for user `36281a1dd30748ed9dcf631e99ec09f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:05.411205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:05.490125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1005/2000] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:05.500498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:05.503469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:05.583342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013216-4a86-4d61-b763-7c5e2715fbff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:05.587104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d015dcd-6d4c-4c93-855d-e1355b2ddd95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:05.587782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d015dcd-6d4c-4c93-855d-e1355b2ddd95 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:05.588045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d015dcd-6d4c-4c93-855d-e1355b2ddd95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:05.588318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d015dcd-6d4c-4c93-855d-e1355b2ddd95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:05.597349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d015dcd-6d4c-4c93-855d-e1355b2ddd95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:05.598817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d015dcd-6d4c-4c93-855d-e1355b2ddd95 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:05.607677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 996/2001] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:05 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:07.923508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:07.925774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:08.020559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4747d28-ec10-47a2-8820-0f2d9a945e20 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:08.025440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:08.030610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:08.030610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:08.030610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] PATH_INFO: `/v3/users/f9b32d49a64e46a7ac7bc69879940349` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:08.030610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b32d49a64e46a7ac7bc69879940349)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:08.030610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:08.224960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b32d49a64e46a7ac7bc69879940349'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.238540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b32d49a64e46a7ac7bc69879940349'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.239276 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b32d49a64e46a7ac7bc69879940349'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.239906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b32d49a64e46a7ac7bc69879940349'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.246767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b32d49a64e46a7ac7bc69879940349'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.335061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1006/2002] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:07 2021] DELETE /identity/v3/users/f9b32d49a64e46a7ac7bc69879940349 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:08.340249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:08.341081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:08.341759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:08.387955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:08.391417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:08.465848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 997/2003] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:08.473567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:08.475072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:08.554482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db85d0-8246-403c-8fce-ed6ac4fce809 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:08.558365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:08.559034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:08.559328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:08.559607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:08.570208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:08.571815 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:08.581218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1007/2004] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:08.714311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:08.715679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:08.727801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4d001-1ad0-4260-83ef-1918dcdf578e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:08.737286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:08.738476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:08.738866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:08.739251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] PATH_INFO: `/v3/users/36281a1dd30748ed9dcf631e99ec09f2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:08.740865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=36281a1dd30748ed9dcf631e99ec09f2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:08.744186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:08.778118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:08.779542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:08.795501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e86682-7f03-44b9-8cf1-ce6e55325dc7 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:08.802072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:08.802997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:08.803288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:08.803589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] PATH_INFO: `/v3/users/e693678cc9684948a1c5b976e198b93c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:08.815655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e693678cc9684948a1c5b976e198b93c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:08.819246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:08.947781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36281a1dd30748ed9dcf631e99ec09f2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.948422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36281a1dd30748ed9dcf631e99ec09f2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.960820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36281a1dd30748ed9dcf631e99ec09f2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:08.961450 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36281a1dd30748ed9dcf631e99ec09f2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.108876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36281a1dd30748ed9dcf631e99ec09f2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.123497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 998/2005] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:08 2021] DELETE /identity/v3/users/36281a1dd30748ed9dcf631e99ec09f2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:09.125069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:09.125225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e693678cc9684948a1c5b976e198b93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.126452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.140653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e693678cc9684948a1c5b976e198b93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.142043 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e693678cc9684948a1c5b976e198b93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.143442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e693678cc9684948a1c5b976e198b93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.151128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2dbe24f0-da66-43e3-8f8c-fe37d152abe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e693678cc9684948a1c5b976e198b93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.196849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7cd46-ad41-4d95-b21c-b990fc5126ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:09.203462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:09.205580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:09.206414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:09.206816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] PATH_INFO: `/v3/projects/a44f37346b994bcf80a383908bb8cc36` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:09.208472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44f37346b994bcf80a383908bb8cc36)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:09.210463 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:09.244021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1008/2006] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:08 2021] DELETE /identity/v3/users/e693678cc9684948a1c5b976e198b93c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:09.245332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469df561-3959-46b6-9b0e-a34331701137 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:09.245628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469df561-3959-46b6-9b0e-a34331701137 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:09.245913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469df561-3959-46b6-9b0e-a34331701137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:09.263752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-469df561-3959-46b6-9b0e-a34331701137 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:09.264940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-469df561-3959-46b6-9b0e-a34331701137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.326437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1009/2007] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:09.330490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:09.330490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:09.330490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:09.353785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44f37346b994bcf80a383908bb8cc36', 'request_id': 'req-b97b52b5-30e0-451b-8b4b-6a79fa056251'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.357455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:09.358723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.359423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44f37346b994bcf80a383908bb8cc36', 'request_id': 'req-b97b52b5-30e0-451b-8b4b-6a79fa056251'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.417561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1010/2008] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:09.418486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:09.419742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.434228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44f37346b994bcf80a383908bb8cc36', 'request_id': 'req-b97b52b5-30e0-451b-8b4b-6a79fa056251'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.448981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] The token cache is being invalidate because project a44f37346b994bcf80a383908bb8cc36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:09.449650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.450617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.452644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 999/2009] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:09 2021] DELETE /identity/v3/projects/a44f37346b994bcf80a383908bb8cc36 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:09.456118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:09.456118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.508522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f655a-4f81-47ec-a57d-eadb968c9544 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:09.512461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:09.513473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:09.513903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:09.514831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:09.517655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.531160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:09.533607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:09.540633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b52b5-30e0-451b-8b4b-6a79fa056251 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:09.547325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1011/2010] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:09.550228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:09.550444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:09.551107 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:09.551394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:09.551764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:09.553040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.555058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.567814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe36f-7244-4f62-b7b9-ed6a73aad1af service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:09.574071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:09.575319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:09.575826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:09.576445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] PATH_INFO: `/v3/users/d4ec949f1471417683f18ba0b940c648` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:09.577939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ec949f1471417683f18ba0b940c648)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:09.578545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:09.583973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:09.584097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:09.609736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1000/2011] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:09.693945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:09.695926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:09.708359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f411b9-d294-43f6-9c06-bc159c31d5a3 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:09.714399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:09.715295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:09.715576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:09.721148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] PATH_INFO: `/v3/users/35cebe7e2f74400f80d0148c9ad82aff` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:09.721148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cebe7e2f74400f80d0148c9ad82aff)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:09.721148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:09.844004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ec949f1471417683f18ba0b940c648'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.855273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ec949f1471417683f18ba0b940c648'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.855933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ec949f1471417683f18ba0b940c648'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.856538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ec949f1471417683f18ba0b940c648'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.863888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f407a083-1f15-4540-bdb2-efe320ed45bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ec949f1471417683f18ba0b940c648'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.956912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1012/2012] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:09 2021] DELETE /identity/v3/users/d4ec949f1471417683f18ba0b940c648 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:09.968583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cebe7e2f74400f80d0148c9ad82aff'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.969615 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cebe7e2f74400f80d0148c9ad82aff'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.988428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cebe7e2f74400f80d0148c9ad82aff'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:09.990587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cebe7e2f74400f80d0148c9ad82aff'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.075522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cebe7e2f74400f80d0148c9ad82aff'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.093340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1001/2013] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:09 2021] DELETE /identity/v3/users/35cebe7e2f74400f80d0148c9ad82aff => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:10.099553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.099891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.100208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.228666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:10.231289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.252583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:10.253747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.336655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c0dcd-c6ad-4b1c-bbed-e52ef29e24fe admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:10.341975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1013/2014] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:10.341975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:10.341975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.352983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:10.354439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.354996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.355143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] PATH_INFO: `/v3/projects/017e6322cda446d9b3d9b6d1ea7456a3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.355975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f76b2-9b2d-4345-b083-fa3a0d8a5fc2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:10.357110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017e6322cda446d9b3d9b6d1ea7456a3)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:10.360757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:10.366358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:10.366358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.366358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.366909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] PATH_INFO: `/v3/projects/633050a6960549ecb11c43df14b40b56` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.368816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633050a6960549ecb11c43df14b40b56)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:10.372023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:10.527817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633050a6960549ecb11c43df14b40b56', 'request_id': 'req-af5841ba-30b7-4385-8d51-6387be1a4e09'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.528441 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017e6322cda446d9b3d9b6d1ea7456a3', 'request_id': 'req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.534869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633050a6960549ecb11c43df14b40b56', 'request_id': 'req-af5841ba-30b7-4385-8d51-6387be1a4e09'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.535134 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017e6322cda446d9b3d9b6d1ea7456a3', 'request_id': 'req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.608768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633050a6960549ecb11c43df14b40b56', 'request_id': 'req-af5841ba-30b7-4385-8d51-6387be1a4e09'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.619805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] The token cache is being invalidate because project 633050a6960549ecb11c43df14b40b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:10.620101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.621079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.622347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1014/2015] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:10 2021] DELETE /identity/v3/projects/633050a6960549ecb11c43df14b40b56 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:10.623106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:10.624700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.660547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017e6322cda446d9b3d9b6d1ea7456a3', 'request_id': 'req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.673206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] The token cache is being invalidate because project 017e6322cda446d9b3d9b6d1ea7456a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:10.673881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.674915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.676768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1002/2016] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:10 2021] DELETE /identity/v3/projects/017e6322cda446d9b3d9b6d1ea7456a3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:10.677757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:10.679327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.683108 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5841ba-30b7-4385-8d51-6387be1a4e09 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:10.686945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff0ec9-3738-488d-88c0-e1e00fda7850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:10.687632 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff0ec9-3738-488d-88c0-e1e00fda7850 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.687894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff0ec9-3738-488d-88c0-e1e00fda7850 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.688168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff0ec9-3738-488d-88c0-e1e00fda7850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.690142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ccff0ec9-3738-488d-88c0-e1e00fda7850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.748937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21f4a-f8f5-45e8-a1e1-c480bf05b8f4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:10.759589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff0ec9-3738-488d-88c0-e1e00fda7850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:10.761030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff0ec9-3738-488d-88c0-e1e00fda7850 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:10.771959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1015/2017] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:10.773103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff973856-aef3-49ca-9c70-01e76339bb1f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.773394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff973856-aef3-49ca-9c70-01e76339bb1f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.773672 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff973856-aef3-49ca-9c70-01e76339bb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.828988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ff973856-aef3-49ca-9c70-01e76339bb1f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:10.830357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ff973856-aef3-49ca-9c70-01e76339bb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.831273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:10.832157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.836907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.836907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] PATH_INFO: `/v3/projects/4d036d37d18447328d62e6f8d4e41a76` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.836907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d036d37d18447328d62e6f8d4e41a76)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:10.836907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:10.840255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1016/2018] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:10.841708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ebd8-aa7a-453a-b266-1f1f2dda7600 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.842134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ebd8-aa7a-453a-b266-1f1f2dda7600 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.842334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804ebd8-aa7a-453a-b266-1f1f2dda7600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.867720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a804ebd8-aa7a-453a-b266-1f1f2dda7600 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:10.869535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a804ebd8-aa7a-453a-b266-1f1f2dda7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.878149 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1017/2019] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:10.885576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867982-aa79-4614-830d-63ccfdc8f1ca None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.885576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867982-aa79-4614-830d-63ccfdc8f1ca None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.885576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867982-aa79-4614-830d-63ccfdc8f1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.898949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c2867982-aa79-4614-830d-63ccfdc8f1ca None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:10.900207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c2867982-aa79-4614-830d-63ccfdc8f1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.908072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1018/2020] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:10.909522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aff4c-796f-44cf-b462-074ce473be7b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:10.909826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aff4c-796f-44cf-b462-074ce473be7b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:10.910154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aff4c-796f-44cf-b462-074ce473be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:10.933736 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-db1aff4c-796f-44cf-b462-074ce473be7b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:10.934991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-db1aff4c-796f-44cf-b462-074ce473be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:10.943757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1019/2021] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:10.944667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1aff4c-796f-44cf-b462-074ce473be7b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:10.954929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1aff4c-796f-44cf-b462-074ce473be7b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:10.972116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d036d37d18447328d62e6f8d4e41a76', 'request_id': 'req-d6d5a0d4-a11d-468e-893c-cba574daa43a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:10.979489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d036d37d18447328d62e6f8d4e41a76', 'request_id': 'req-d6d5a0d4-a11d-468e-893c-cba574daa43a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.042895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.044335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.044697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.045343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.046479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:11.046853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.050510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.063289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d036d37d18447328d62e6f8d4e41a76', 'request_id': 'req-d6d5a0d4-a11d-468e-893c-cba574daa43a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.064489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1020/2022] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:11.069062 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.081308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb3b83-d1a1-4ee5-bbe8-d6000d17912c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.082082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] The token cache is being invalidate because project 4d036d37d18447328d62e6f8d4e41a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:11.082553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.083470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.086424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1003/2023] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:10 2021] DELETE /identity/v3/projects/4d036d37d18447328d62e6f8d4e41a76 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:11.087624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94061b-9cc6-4d8d-8f93-25f63ee58ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.088305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94061b-9cc6-4d8d-8f93-25f63ee58ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.088602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94061b-9cc6-4d8d-8f93-25f63ee58ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.088879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94061b-9cc6-4d8d-8f93-25f63ee58ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.089628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94061b-9cc6-4d8d-8f93-25f63ee58ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:11.089933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94061b-9cc6-4d8d-8f93-25f63ee58ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.091688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94061b-9cc6-4d8d-8f93-25f63ee58ac9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.092373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.093319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.104732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1021/2024] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:11.106128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.106516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.106764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.112660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a0d4-a11d-468e-893c-cba574daa43a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.118255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a866-4ce3-47e5-82ec-4dba7fe2ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.121658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a866-4ce3-47e5-82ec-4dba7fe2ef51 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.121658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a866-4ce3-47e5-82ec-4dba7fe2ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.121658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a866-4ce3-47e5-82ec-4dba7fe2ef51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.121658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a866-4ce3-47e5-82ec-4dba7fe2ef51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.123357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a866-4ce3-47e5-82ec-4dba7fe2ef51 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.127582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:11.128860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.142235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1022/2025] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:11.142235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.142235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.160488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4533b-a9c2-48fa-bac6-f7384eea1dd5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.165294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.165962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.166293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.166572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.167286 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.169182 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.242679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1004/2026] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:11.244251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.244709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.244993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.264771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:11.268684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.268839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1023/2027] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:11.268839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.345331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faebd1-bb56-4f6b-87c6-c2bd2e298be7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.350360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.351026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.354446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.354446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.354446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.354446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.357698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1005/2028] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:11.358498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.359884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.373000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe102c3-9e4c-4b37-bcbc-0b341352e4d9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.383525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.384400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.384686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.384962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] PATH_INFO: `/v3/projects/7c7427e2d66f4ddba9b4ddfccde9c8c6` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.386242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7427e2d66f4ddba9b4ddfccde9c8c6)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.388168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.430669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1024/2029] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:11.435416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.446467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0ac5d-7018-4eec-b39d-4fdb0b85ed52 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.452463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.452716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.453009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.453287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.454142 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.457098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.517590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7427e2d66f4ddba9b4ddfccde9c8c6', 'request_id': 'req-57863962-73d5-4fe2-b496-27d31ee539fa'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.522768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7427e2d66f4ddba9b4ddfccde9c8c6', 'request_id': 'req-57863962-73d5-4fe2-b496-27d31ee539fa'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.534489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1025/2030] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:11.535307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.546048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a650-7269-4ca5-a07c-ff057211b87b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.605051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.605720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.606000 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.606314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.607458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:11.607701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.608650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7427e2d66f4ddba9b4ddfccde9c8c6', 'request_id': 'req-57863962-73d5-4fe2-b496-27d31ee539fa'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.609407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.621387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] The token cache is being invalidate because project 7c7427e2d66f4ddba9b4ddfccde9c8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:11.621683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.621990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1026/2031] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:11.622520 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.624235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1006/2032] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:11 2021] DELETE /identity/v3/projects/7c7427e2d66f4ddba9b4ddfccde9c8c6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:11.626056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.626168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.627938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.628088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.640965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165bddc-7bea-4702-b921-6a3c4c204830 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.643636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57863962-73d5-4fe2-b496-27d31ee539fa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.646134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.646892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.647174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.647482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.648260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.649103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.649779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.649952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.650091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.650471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.651225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.652929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.667998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1007/2033] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:11 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:11.668355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1027/2034] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:11 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:11.668697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.669230 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.670610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.671165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.684392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199e6d1-852d-4732-ae71-91e5a2ba7fb4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.684865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9120390-15c6-47f5-997b-605fdbaa6dc5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.689015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.689921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.690053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.690263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.690520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] PATH_INFO: `/v3/users/b42b4bfa80a84edeb3f312cbb60f169d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.690685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.690965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.691247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.691714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42b4bfa80a84edeb3f312cbb60f169d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.691950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.693629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.693837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.764255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1008/2035] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:11.765387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.828820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ef28e-b125-44f5-b479-8b678671b29f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.833768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.834617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.834905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.835186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.835937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.837590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.849118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1009/2036] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:11 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:11.851624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.860179 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d95940-5295-40ce-8032-5a4f5c52ae59 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.862026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42b4bfa80a84edeb3f312cbb60f169d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.866711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.867537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.867982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.868262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.869122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.870981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.876278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42b4bfa80a84edeb3f312cbb60f169d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.880394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42b4bfa80a84edeb3f312cbb60f169d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.880394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42b4bfa80a84edeb3f312cbb60f169d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.882869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1010/2037] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:11.883794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.885685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:11.888404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42b4bfa80a84edeb3f312cbb60f169d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:11.899420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a92b-0b23-47b9-a2a8-d1b83492efe4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:11.904278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:11.904983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:11.909126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:11.909126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:11.909126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:11.909126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:11.992042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1028/2038] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:11 2021] DELETE /identity/v3/users/b42b4bfa80a84edeb3f312cbb60f169d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:11.992848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:11.994159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.062986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1011/2039] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:11 2021] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:12.064549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.068068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.082831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96317c7c-0fdf-4bf8-9dee-7e781cb6cb6e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.087540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.088573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.088888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.089226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] PATH_INFO: `/v3/projects/8fa5e8626d31474c8fe835897630b190/users/fa8bccbe8aa147828ce6a59558252ec3/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.091403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86621d7-80da-4a16-8475-7b9b1f967858 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.107096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa5e8626d31474c8fe835897630b190, user_id=fa8bccbe8aa147828ce6a59558252ec3, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.108347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d00d3-dd7a-4e3a-9375-6f72c77518a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.109394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d00d3-dd7a-4e3a-9375-6f72c77518a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.109750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d00d3-dd7a-4e3a-9375-6f72c77518a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.110465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d00d3-dd7a-4e3a-9375-6f72c77518a6 admin admin] PATH_INFO: `/v3/projects/6a01708ed98b42e6b8bd3cf784e5f0e9/users/3eed219194494c3187d8db99ea7cdbb4/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.110620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.131192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d00d3-dd7a-4e3a-9375-6f72c77518a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a01708ed98b42e6b8bd3cf784e5f0e9, user_id=3eed219194494c3187d8db99ea7cdbb4, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.134290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d00d3-dd7a-4e3a-9375-6f72c77518a6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.202797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1029/2040] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:11 2021] PUT /identity/v3/projects/8fa5e8626d31474c8fe835897630b190/users/fa8bccbe8aa147828ce6a59558252ec3/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:12.209562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.228518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1012/2041] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:12 2021] PUT /identity/v3/projects/6a01708ed98b42e6b8bd3cf784e5f0e9/users/3eed219194494c3187d8db99ea7cdbb4/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:12.229070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208bfa-6a4d-4bd6-aa26-aff13f2dda3b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.242394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208bfa-6a4d-4bd6-aa26-aff13f2dda3b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.242394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66208bfa-6a4d-4bd6-aa26-aff13f2dda3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.260306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-66208bfa-6a4d-4bd6-aa26-aff13f2dda3b None None] MFA Rules not processed for user `fa8bccbe8aa147828ce6a59558252ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:12.261766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-66208bfa-6a4d-4bd6-aa26-aff13f2dda3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.294949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354692c-7c3e-458d-b11d-2686e9315e8c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.339877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1013/2042] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:12.341129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39fe9-2703-4f55-b77f-8bd862025c32 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.341426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39fe9-2703-4f55-b77f-8bd862025c32 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.341703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39fe9-2703-4f55-b77f-8bd862025c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.365858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.366596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.366932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.367211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.368130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.369724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.372830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4ac39fe9-2703-4f55-b77f-8bd862025c32 None None] MFA Rules not processed for user `3eed219194494c3187d8db99ea7cdbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:12.374324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4ac39fe9-2703-4f55-b77f-8bd862025c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.380693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1030/2043] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:12 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:12.381446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.383112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.444967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1014/2044] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:12.446409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac39fe9-2703-4f55-b77f-8bd862025c32 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.456523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac39fe9-2703-4f55-b77f-8bd862025c32 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.461061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.462005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.462005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.462374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.463027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.469158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.469300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6253c8-bbc8-44ba-b7f6-64a5b918ae88 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.477046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1015/2045] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:12.477988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.478916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.479575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.479854 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.480071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.480377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.488984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.490594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.500584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1031/2046] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:12 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:12.501384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.520312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d807b30-bd49-4502-a527-7413b91bad13 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.531344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b5c4-3b6b-4014-b49f-a44530fb5dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.531344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b5c4-3b6b-4014-b49f-a44530fb5dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.531344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b5c4-3b6b-4014-b49f-a44530fb5dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.531344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b5c4-3b6b-4014-b49f-a44530fb5dfe admin admin] PATH_INFO: `/v3/projects/df838c19f0ff4f70a7b46c4aad5fcfd1/users/6410af92acd44ff4afa743c3731ec20a/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.556666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b5c4-3b6b-4014-b49f-a44530fb5dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=df838c19f0ff4f70a7b46c4aad5fcfd1, user_id=6410af92acd44ff4afa743c3731ec20a, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.559002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b5c4-3b6b-4014-b49f-a44530fb5dfe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.577801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698058fb-702b-4042-9029-81d48452bf0e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.581987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.582669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.582956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.583233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.593828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.593828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.604329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1016/2047] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:12 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:12.605556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.606081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.622462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc54d9-84af-40ed-90c2-125fa99844d1 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.629225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.630080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.634268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.634268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] PATH_INFO: `/v3/projects/b3db4004c465457fbe0bcd475822cc87` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.634268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3db4004c465457fbe0bcd475822cc87)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.634268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.667370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1032/2048] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:12 2021] PUT /identity/v3/projects/df838c19f0ff4f70a7b46c4aad5fcfd1/users/6410af92acd44ff4afa743c3731ec20a/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:12.677106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e173cc5-3d45-4f81-91ee-8bd07c7b1e21 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.677291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e173cc5-3d45-4f81-91ee-8bd07c7b1e21 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.677573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e173cc5-3d45-4f81-91ee-8bd07c7b1e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.715504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9e173cc5-3d45-4f81-91ee-8bd07c7b1e21 None None] MFA Rules not processed for user `6410af92acd44ff4afa743c3731ec20a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:12.717053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9e173cc5-3d45-4f81-91ee-8bd07c7b1e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.764167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3db4004c465457fbe0bcd475822cc87', 'request_id': 'req-b8cd1130-04ae-402e-bc96-aecc86d9fde8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:12.772028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3db4004c465457fbe0bcd475822cc87', 'request_id': 'req-b8cd1130-04ae-402e-bc96-aecc86d9fde8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:12.790804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1033/2049] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:12.795099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e173cc5-3d45-4f81-91ee-8bd07c7b1e21 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.851440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3db4004c465457fbe0bcd475822cc87', 'request_id': 'req-b8cd1130-04ae-402e-bc96-aecc86d9fde8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:12.862828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e173cc5-3d45-4f81-91ee-8bd07c7b1e21 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.864780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] The token cache is being invalidate because project b3db4004c465457fbe0bcd475822cc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:12.865075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:12.865730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:12.867426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1017/2050] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:12 2021] DELETE /identity/v3/projects/b3db4004c465457fbe0bcd475822cc87 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:12.868247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:12.869563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:12.924610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.925548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.925831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.926106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] PATH_INFO: `/v3/users/fa8bccbe8aa147828ce6a59558252ec3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.927356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8bccbe8aa147828ce6a59558252ec3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.929364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:12.934833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1130-04ae-402e-bc96-aecc86d9fde8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:12.941724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:12.942434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:12.942906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:12.943188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:12.943909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:12.945860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.100103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1018/2051] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:12 2021] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:13.101385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.103288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:13.169165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8bccbe8aa147828ce6a59558252ec3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.180617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe7515-858a-4cda-a3d1-c5794c78c579 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:13.183876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8bccbe8aa147828ce6a59558252ec3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.184544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8bccbe8aa147828ce6a59558252ec3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.185180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8bccbe8aa147828ce6a59558252ec3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.186090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:13.186984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.187268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.187545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] PATH_INFO: `/v3/users/a89ab6b96a5a4f93a80bdda4867c6477` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.188766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89ab6b96a5a4f93a80bdda4867c6477)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:13.192469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.193399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8bccbe8aa147828ce6a59558252ec3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.281119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1034/2052] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:12 2021] DELETE /identity/v3/users/fa8bccbe8aa147828ce6a59558252ec3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:13.281783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.284368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:13.370536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da802f-a002-4dc2-9b8c-817e0be6b92c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:13.397405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89ab6b96a5a4f93a80bdda4867c6477'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.397876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb44694-438c-4ef7-94ab-bc05bd1db744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:13.399216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44694-438c-4ef7-94ab-bc05bd1db744 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.399505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44694-438c-4ef7-94ab-bc05bd1db744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.399992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89ab6b96a5a4f93a80bdda4867c6477'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.401692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44694-438c-4ef7-94ab-bc05bd1db744 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.403654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb44694-438c-4ef7-94ab-bc05bd1db744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:13.405900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb44694-438c-4ef7-94ab-bc05bd1db744 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.421231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89ab6b96a5a4f93a80bdda4867c6477'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.422346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89ab6b96a5a4f93a80bdda4867c6477'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.494168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89ab6b96a5a4f93a80bdda4867c6477'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:13.501453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1035/2053] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:13 2021] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:13.503666 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.503949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.504221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.511557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1019/2054] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:13 2021] DELETE /identity/v3/users/a89ab6b96a5a4f93a80bdda4867c6477 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:13.512243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.513541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:13.522584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:13.523775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:13.595430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1036/2055] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:13.605168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.606573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:13.625263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c6557-9234-4537-8a33-72a28c4157fe admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:13.625263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:13.625263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.625263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.625677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.626723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:13.629092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.644469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1020/2056] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:13 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:13.645595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.655429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa497-93d1-4233-b966-cc8906247d78 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:13.660959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:13.661873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.662151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.662456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] PATH_INFO: `/v3/projects/1714bee9c31a42b19b5c88dd7cb7361c/users/dc023642921c45c28eb1347eb56a265e/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.666432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc474180-b998-49b5-aca9-31cb90bfae0e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:13.670138 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:13.670809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.671097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.671376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.678366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1714bee9c31a42b19b5c88dd7cb7361c, user_id=dc023642921c45c28eb1347eb56a265e, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:13.681071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.685293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:13.686690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.697024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1037/2057] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:13.777735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1021/2058] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:13 2021] PUT /identity/v3/projects/1714bee9c31a42b19b5c88dd7cb7361c/users/dc023642921c45c28eb1347eb56a265e/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:13.783166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.792753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433386-073a-4e2b-8a59-9f7f0324b1a4 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:13.847984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bdc1c-1d8e-4af2-b30c-f670179fc461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:13.848654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdc1c-1d8e-4af2-b30c-f670179fc461 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.848935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdc1c-1d8e-4af2-b30c-f670179fc461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.849210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bdc1c-1d8e-4af2-b30c-f670179fc461 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.850004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bdc1c-1d8e-4af2-b30c-f670179fc461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:13.851654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bdc1c-1d8e-4af2-b30c-f670179fc461 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.862427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1038/2059] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:13 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:13.866719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.877208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf222c38-8f8c-4fbb-b810-9dc8ef6858a6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:13.881883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:13.882805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.883089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.883390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] PATH_INFO: `/v3/projects/1714bee9c31a42b19b5c88dd7cb7361c/users/dc023642921c45c28eb1347eb56a265e/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.885385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1714bee9c31a42b19b5c88dd7cb7361c, user_id=dc023642921c45c28eb1347eb56a265e, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:13.888045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:13.901315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1022/2060] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:13 2021] PUT /identity/v3/projects/1714bee9c31a42b19b5c88dd7cb7361c/users/dc023642921c45c28eb1347eb56a265e/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:13.912996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:13.913306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:13.913570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:13.942740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] MFA Rules not processed for user `dc023642921c45c28eb1347eb56a265e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:13.944038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:13.991075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:13.993301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:14.024295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1039/2061] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:13 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:14.034793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.036265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:14.098607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a151b5-2052-40f4-84e1-cf3b70533286 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.099673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c96c62-a85b-4aac-bc10-a649c7247b8d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.102371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.103009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.103288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.103561 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.104517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.105525 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.105811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.106206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] PATH_INFO: `/v3/projects/8bcb24e6d32b493b959b175df964ab68` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.107449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcb24e6d32b493b959b175df964ab68)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.109468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.113895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.115501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.124834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1040/2062] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:14 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:14.152811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.154266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:14.172628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b03f0-b20b-4934-a7f5-b372edd10b84 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.178463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.179386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.179664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.179943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] PATH_INFO: `/v3/projects/8fa5e8626d31474c8fe835897630b190` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.181291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa5e8626d31474c8fe835897630b190)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.183253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.235402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcb24e6d32b493b959b175df964ab68', 'request_id': 'req-120dc3eb-3e8d-43ee-aa94-b764c758ac17'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.241286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcb24e6d32b493b959b175df964ab68', 'request_id': 'req-120dc3eb-3e8d-43ee-aa94-b764c758ac17'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.312690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa5e8626d31474c8fe835897630b190', 'request_id': 'req-99803c1a-e7aa-4693-9a31-8cc55e68a931'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.319574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa5e8626d31474c8fe835897630b190', 'request_id': 'req-99803c1a-e7aa-4693-9a31-8cc55e68a931'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.323351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcb24e6d32b493b959b175df964ab68', 'request_id': 'req-120dc3eb-3e8d-43ee-aa94-b764c758ac17'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.336400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] The token cache is being invalidate because project 8bcb24e6d32b493b959b175df964ab68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:14.336688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.337353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-120dc3eb-3e8d-43ee-aa94-b764c758ac17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.339164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1023/2063] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:13 2021] DELETE /identity/v3/projects/8bcb24e6d32b493b959b175df964ab68 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:14.346307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da07f7-df83-4a93-b96e-61d364f721a1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.346457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da07f7-df83-4a93-b96e-61d364f721a1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.348176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da07f7-df83-4a93-b96e-61d364f721a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.365063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b4da07f7-df83-4a93-b96e-61d364f721a1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:14.365994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b4da07f7-df83-4a93-b96e-61d364f721a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:14.405944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa5e8626d31474c8fe835897630b190', 'request_id': 'req-99803c1a-e7aa-4693-9a31-8cc55e68a931'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.419719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] The token cache is being invalidate because project 8fa5e8626d31474c8fe835897630b190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:14.420153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.421398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-99803c1a-e7aa-4693-9a31-8cc55e68a931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:14.425812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1041/2064] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:14 2021] DELETE /identity/v3/projects/8fa5e8626d31474c8fe835897630b190 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:14.432346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717bf3-3135-42ae-98e5-a8acef0e5090 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.432701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717bf3-3135-42ae-98e5-a8acef0e5090 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.433080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717bf3-3135-42ae-98e5-a8acef0e5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.434067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1024/2065] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:14.442918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d6f0-6053-4409-81bd-51e4f11fe694 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.443359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d6f0-6053-4409-81bd-51e4f11fe694 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.445616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d6f0-6053-4409-81bd-51e4f11fe694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.463273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7a717bf3-3135-42ae-98e5-a8acef0e5090 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:14.464577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7a717bf3-3135-42ae-98e5-a8acef0e5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:14.474618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5b07d6f0-6053-4409-81bd-51e4f11fe694 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:14.475344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5b07d6f0-6053-4409-81bd-51e4f11fe694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:14.481133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1042/2066] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:14.483151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef635f-72e2-424e-a784-69c5838c835b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.483539 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef635f-72e2-424e-a784-69c5838c835b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.483917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef635f-72e2-424e-a784-69c5838c835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.485068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1025/2067] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:14.489637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07d6f0-6053-4409-81bd-51e4f11fe694 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.514620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07d6f0-6053-4409-81bd-51e4f11fe694 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.514728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c7ef635f-72e2-424e-a784-69c5838c835b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:14.514728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c7ef635f-72e2-424e-a784-69c5838c835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:14.515689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.518148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.518641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.519332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.520338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:14.520809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.522883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.523781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1043/2068] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:14.528168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef635f-72e2-424e-a784-69c5838c835b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.538338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1026/2069] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:35:14.549174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef635f-72e2-424e-a784-69c5838c835b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.552626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.558748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.559532 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.559892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.560297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.561191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:14.561500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.563316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.564637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2437536-269f-4fc4-9153-b3a3dc577c1c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.570681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.572314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.572915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.573338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.574278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.576829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.583468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1044/2070] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:14.587374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.608678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefaae5-3868-40b8-b1d7-824d04763db9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.615221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.615889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.616179 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.616458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.617232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.619193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.686280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1027/2071] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:14.687166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.706558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1045/2072] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:14.716935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.763872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf4f2-5aee-4195-aa4f-572272597916 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.785839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0261f-573d-471c-986d-f7f3b2bfd973 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.794264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.794264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.794264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.794264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.794590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.794810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.825237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.825237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.825237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.825237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.825608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.827028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.901760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1046/2073] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:14.902726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.920352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1028/2074] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:14 2021] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:14.922883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.922998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4d89-99ba-4ed9-931e-04afde6b54b5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.928437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.929195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.929714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.930015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.930860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.932789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.935628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467780e-8adc-4973-9c3e-c1512e0053af admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.940625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.941322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.941658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.941961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.945388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.945388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.945590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1047/2075] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:14 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:14.948472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.956093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1029/2076] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:14.960097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.961879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd45a1-befc-4e1b-a6e6-50a55047db65 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.966815 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.967545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.967898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.968246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.969055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.971335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.973172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbf2d-805f-49d2-b66d-aeb1a4d7bc62 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.980173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:14.984353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:14.984353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:14.984353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:14.984753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1048/2077] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:14.984847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:14.984847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:14.985724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:14.995978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f15144-b05d-4993-9b16-4623255f245d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:14.999803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1030/2078] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:14 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:15.001102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea961b-72ff-4c7c-ae32-1543f212a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.002108 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea961b-72ff-4c7c-ae32-1543f212a505 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.002455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea961b-72ff-4c7c-ae32-1543f212a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.006431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea961b-72ff-4c7c-ae32-1543f212a505 admin admin] PATH_INFO: `/v3/projects/e66d44d5a63742bda1a43b611060be2f/users/00480a838cdc42198100c17f9081c0d5/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.006545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.014391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836bbae-dc50-48f0-a91e-3e160e8dbe88 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.022318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d39b6-b265-4652-8fa1-2bae92ae50ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.023286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d39b6-b265-4652-8fa1-2bae92ae50ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.023683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d39b6-b265-4652-8fa1-2bae92ae50ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.023966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d39b6-b265-4652-8fa1-2bae92ae50ee admin admin] PATH_INFO: `/v3/projects/87cdc904ce144e28acf3fd931ad34b34/users/2333e2e1b9d74663b88af72dcb19e334/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.025319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea961b-72ff-4c7c-ae32-1543f212a505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66d44d5a63742bda1a43b611060be2f, user_id=00480a838cdc42198100c17f9081c0d5, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.028210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea961b-72ff-4c7c-ae32-1543f212a505 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.039365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d39b6-b265-4652-8fa1-2bae92ae50ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cdc904ce144e28acf3fd931ad34b34, user_id=2333e2e1b9d74663b88af72dcb19e334, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.042022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d39b6-b265-4652-8fa1-2bae92ae50ee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.130947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1031/2079] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:15 2021] PUT /identity/v3/projects/87cdc904ce144e28acf3fd931ad34b34/users/2333e2e1b9d74663b88af72dcb19e334/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:15.137656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1049/2080] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:14 2021] PUT /identity/v3/projects/e66d44d5a63742bda1a43b611060be2f/users/00480a838cdc42198100c17f9081c0d5/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:15.148011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c472-b3ea-495b-92e9-b80079b19af5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.148307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c472-b3ea-495b-92e9-b80079b19af5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.148593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c472-b3ea-495b-92e9-b80079b19af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.151262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995966-8bd8-4633-9c76-ecfe46352217 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.151553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995966-8bd8-4633-9c76-ecfe46352217 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.151826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995966-8bd8-4633-9c76-ecfe46352217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.186029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9056c472-b3ea-495b-92e9-b80079b19af5 None None] MFA Rules not processed for user `00480a838cdc42198100c17f9081c0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:15.187569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9056c472-b3ea-495b-92e9-b80079b19af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:15.198323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-be995966-8bd8-4633-9c76-ecfe46352217 None None] MFA Rules not processed for user `2333e2e1b9d74663b88af72dcb19e334`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:15.198323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-be995966-8bd8-4633-9c76-ecfe46352217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:15.268609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1050/2081] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:15 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:15.273116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1032/2082] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:15 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:15.275468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be995966-8bd8-4633-9c76-ecfe46352217 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.277355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056c472-b3ea-495b-92e9-b80079b19af5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.339156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be995966-8bd8-4633-9c76-ecfe46352217 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.342225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056c472-b3ea-495b-92e9-b80079b19af5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.352034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.352034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.352034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.352034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.353019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.353993 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.354135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.359510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.359871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.360624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.362774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.364757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.435631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1033/2083] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:15 2021] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:15.440637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.463869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1051/2084] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:15 2021] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:15.467462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.550682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e7387-5a2b-46e0-bb78-4aeee17ec4b0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.566814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b1173-7e62-4efc-89f7-c0a8de6ebfa9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.573859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.574968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.607250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.607250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.607250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.607250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.709759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1052/2085] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:15 2021] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:15.713018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.714384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:15.728493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544f67d-f7f3-4ba5-acc1-d55d0b68733b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.733496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.734379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.734665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.734940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] PATH_INFO: `/v3/users/6410af92acd44ff4afa743c3731ec20a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.736754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6410af92acd44ff4afa743c3731ec20a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.738943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.747679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.750405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.750405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.750405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.750405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.751535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.846138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1034/2086] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:15 2021] POST /identity/v3/users => generated 297 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:15.846138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.853860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1042041-b077-4a9c-ad14-f74a30ae5e1d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.858533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.859167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.859444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.859714 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.860445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.862577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.872513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1035/2087] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:15.873289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.882314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193293-4699-41f4-94f2-e0577a281f4a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.886826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.887423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.887703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.887982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.888684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.890262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.901248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1036/2088] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:15 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:15.901983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:15.911997 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a90fa-553d-40ed-8258-290813151368 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:15.916717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:15.917582 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:15.917872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:15.918193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] PATH_INFO: `/v3/projects/5d9c74c6a48d4894b17f6281bf2be18c/users/450750ab45414874abde4574a07a3ab2/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:15.919956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6410af92acd44ff4afa743c3731ec20a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:15.931549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6410af92acd44ff4afa743c3731ec20a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:15.932206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6410af92acd44ff4afa743c3731ec20a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:15.932813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6410af92acd44ff4afa743c3731ec20a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:15.932923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9c74c6a48d4894b17f6281bf2be18c, user_id=450750ab45414874abde4574a07a3ab2, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:15.935634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:15.939461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6410af92acd44ff4afa743c3731ec20a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:16.005732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1037/2089] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:15 2021] PUT /identity/v3/projects/5d9c74c6a48d4894b17f6281bf2be18c/users/450750ab45414874abde4574a07a3ab2/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:16.006695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.008199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.037827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1053/2090] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:15 2021] DELETE /identity/v3/users/6410af92acd44ff4afa743c3731ec20a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:16.038830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.040465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.072372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dc505-50eb-4725-9eef-ac618853bde2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.103927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c26fe9-1bd4-441f-8938-536d975ee38c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.108915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f5ac1-ba45-4a0e-8d5e-2179e8a6d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.109716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5ac1-ba45-4a0e-8d5e-2179e8a6d6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.110331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5ac1-ba45-4a0e-8d5e-2179e8a6d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.110331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5ac1-ba45-4a0e-8d5e-2179e8a6d6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.111425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f5ac1-ba45-4a0e-8d5e-2179e8a6d6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.113204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f5ac1-ba45-4a0e-8d5e-2179e8a6d6e5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.128503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1054/2091] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:16 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:16.128503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b2a0a-93dd-4984-9c58-9d44bfdb7e63 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.128503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b2a0a-93dd-4984-9c58-9d44bfdb7e63 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.128503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b2a0a-93dd-4984-9c58-9d44bfdb7e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.131115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fcc60-f478-4812-bf14-44c00fd729bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.132145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fcc60-f478-4812-bf14-44c00fd729bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.132432 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fcc60-f478-4812-bf14-44c00fd729bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.132715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fcc60-f478-4812-bf14-44c00fd729bb admin admin] PATH_INFO: `/v3/projects/0e15adc3a38a4c39afdc2d1645579488/users/dc79596fc1184ba0a77a799958f2d93c/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.147644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-599b2a0a-93dd-4984-9c58-9d44bfdb7e63 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:16.148769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fcc60-f478-4812-bf14-44c00fd729bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e15adc3a38a4c39afdc2d1645579488, user_id=dc79596fc1184ba0a77a799958f2d93c, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.148872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-599b2a0a-93dd-4984-9c58-9d44bfdb7e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.151698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fcc60-f478-4812-bf14-44c00fd729bb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.156428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1055/2092] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:16.157311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b2a0a-93dd-4984-9c58-9d44bfdb7e63 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.166817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b2a0a-93dd-4984-9c58-9d44bfdb7e63 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.171291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.172147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.172423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.172780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] PATH_INFO: `/v3/projects/5d9c74c6a48d4894b17f6281bf2be18c/users/450750ab45414874abde4574a07a3ab2/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.174992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9c74c6a48d4894b17f6281bf2be18c, user_id=450750ab45414874abde4574a07a3ab2, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.177684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.187976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1056/2093] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:16 2021] PUT /identity/v3/projects/5d9c74c6a48d4894b17f6281bf2be18c/users/450750ab45414874abde4574a07a3ab2/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:16.189551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.191248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.243082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1038/2094] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:16 2021] PUT /identity/v3/projects/0e15adc3a38a4c39afdc2d1645579488/users/dc79596fc1184ba0a77a799958f2d93c/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:16.245127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f621c7-5f0f-4bcd-90f8-0efc40d533b4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.251059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f621c7-5f0f-4bcd-90f8-0efc40d533b4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.251059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f621c7-5f0f-4bcd-90f8-0efc40d533b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.257045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923504c-4362-4f90-96f8-c755cc8df5cd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.285724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a2f621c7-5f0f-4bcd-90f8-0efc40d533b4 None None] MFA Rules not processed for user `450750ab45414874abde4574a07a3ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:16.285724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a2f621c7-5f0f-4bcd-90f8-0efc40d533b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.308041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.308691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.310291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.310291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.374351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1039/2095] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:16 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:16.375364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f621c7-5f0f-4bcd-90f8-0efc40d533b4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.378209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.379888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.391888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1057/2096] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:16.397893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f621c7-5f0f-4bcd-90f8-0efc40d533b4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.403620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8588727-c5a1-45f2-bc4e-6f31b0807d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.404285 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588727-c5a1-45f2-bc4e-6f31b0807d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.404571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588727-c5a1-45f2-bc4e-6f31b0807d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.405623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8588727-c5a1-45f2-bc4e-6f31b0807d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.406536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8588727-c5a1-45f2-bc4e-6f31b0807d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.408490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8588727-c5a1-45f2-bc4e-6f31b0807d6a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.422809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1040/2097] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:16 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:16.423190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.432651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba080df9-4568-4c65-a37e-1ddce9a3afc0 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.437308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.438215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.438500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.438786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] PATH_INFO: `/v3/projects/0e15adc3a38a4c39afdc2d1645579488/users/dc79596fc1184ba0a77a799958f2d93c/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.441444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e15adc3a38a4c39afdc2d1645579488, user_id=dc79596fc1184ba0a77a799958f2d93c, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.444224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.455403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1058/2098] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:16 2021] PUT /identity/v3/projects/0e15adc3a38a4c39afdc2d1645579488/users/dc79596fc1184ba0a77a799958f2d93c/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:16.467084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.467613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.467613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.497566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] MFA Rules not processed for user `dc79596fc1184ba0a77a799958f2d93c`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:16.498916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.570386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1041/2099] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:16 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:16.720937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.722998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.787996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc87ac-9ca7-4e28-922e-5b266f8cf4b8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.793869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.794705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.794994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.795272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.837227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.840890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:16.860665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9150e6d-34b7-40b3-8fd4-90f4100a3361 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:16.865341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:16.865980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:16.866295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:16.866574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:16.869648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.871130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.875964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:16.877527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:16.880815 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1059/2100] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:16 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:16.887705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1042/2101] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:16 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:16.982951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:16.986808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:17.046435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:17.055691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085fb7e-abb6-4fd6-908c-04d1f9bb578b service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:17.059460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:17.060093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:17.060370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:17.060639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:17.062445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:17.066670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1bdbf-5ab7-43ca-86b4-d9f1e208f094 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:17.072140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:17.073481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:17.085370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:17.085370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] PATH_INFO: `/v3/projects/df838c19f0ff4f70a7b46c4aad5fcfd1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:17.085370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df838c19f0ff4f70a7b46c4aad5fcfd1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:17.085370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:17.144523 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:17.146112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:17.156711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1043/2102] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:17 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:17.157537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:17.167220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f8c31-6dd8-4732-aba5-07e2b2b598ba service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:17.171689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:17.172337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:17.172616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:17.172892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:17.175907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:17.185893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df838c19f0ff4f70a7b46c4aad5fcfd1', 'request_id': 'req-03a19aa4-66db-40f6-bb79-90784f6fff93'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.193319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df838c19f0ff4f70a7b46c4aad5fcfd1', 'request_id': 'req-03a19aa4-66db-40f6-bb79-90784f6fff93'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.241733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:17.243192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:17.252687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1044/2103] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:17 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:17.300852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df838c19f0ff4f70a7b46c4aad5fcfd1', 'request_id': 'req-03a19aa4-66db-40f6-bb79-90784f6fff93'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.313507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] The token cache is being invalidate because project df838c19f0ff4f70a7b46c4aad5fcfd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:17.313791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.315267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03a19aa4-66db-40f6-bb79-90784f6fff93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.317050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1060/2104] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:16 2021] DELETE /identity/v3/projects/df838c19f0ff4f70a7b46c4aad5fcfd1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:17.321226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:17.332049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d5395-7f30-40f1-9acb-c7c3840c13b5 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:17.388067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:17.388920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:17.389198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:17.389468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] PATH_INFO: `/v3/users/dc023642921c45c28eb1347eb56a265e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:17.390711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc023642921c45c28eb1347eb56a265e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:17.392916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:17.601705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc023642921c45c28eb1347eb56a265e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.602411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc023642921c45c28eb1347eb56a265e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.614085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc023642921c45c28eb1347eb56a265e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.614725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc023642921c45c28eb1347eb56a265e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.684301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e9be1-55aa-415e-b4c1-aafea9d9caec None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:17.684590 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e9be1-55aa-415e-b4c1-aafea9d9caec None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:17.684873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e9be1-55aa-415e-b4c1-aafea9d9caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:17.694628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc023642921c45c28eb1347eb56a265e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:17.703064 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-030e9be1-55aa-415e-b4c1-aafea9d9caec None None] MFA Rules not processed for user `01987e7fb04b44bcbe2c57f635fb5e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:17.704454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-030e9be1-55aa-415e-b4c1-aafea9d9caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:17.708960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1045/2105] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:17 2021] DELETE /identity/v3/users/dc023642921c45c28eb1347eb56a265e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:17.765183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1061/2106] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:17 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:17.859908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:17.862063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:17.979777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5894d-f987-4839-9330-684ac4dec17f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:17.985061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:17.985958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:17.986314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:17.986632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] PATH_INFO: `/v3/users/2333e2e1b9d74663b88af72dcb19e334` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:17.988983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2333e2e1b9d74663b88af72dcb19e334)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:17.990705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:18.191009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2333e2e1b9d74663b88af72dcb19e334'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.191718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2333e2e1b9d74663b88af72dcb19e334'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.204619 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2333e2e1b9d74663b88af72dcb19e334'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.209479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2333e2e1b9d74663b88af72dcb19e334'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.285765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2333e2e1b9d74663b88af72dcb19e334'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.305988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1046/2107] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:17 2021] DELETE /identity/v3/users/2333e2e1b9d74663b88af72dcb19e334 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:18.306884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:18.307558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:18.307843 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:18.336361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:18.337916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:18.385731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:18.387621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:18.441383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1062/2108] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:18.449154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:18.451126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:18.469579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad5be5-8fdb-4c93-adf9-8fd06f6c7277 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:18.475308 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:18.476160 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:18.476439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:18.476713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] PATH_INFO: `/v3/projects/1714bee9c31a42b19b5c88dd7cb7361c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:18.478022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1714bee9c31a42b19b5c88dd7cb7361c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:18.480153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:18.533540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003c36-78d1-4ec9-8851-ed8846876369 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:18.540850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b3abc-4189-4d75-a794-ff6769fa9591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:18.540850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b3abc-4189-4d75-a794-ff6769fa9591 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:18.540850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b3abc-4189-4d75-a794-ff6769fa9591 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:18.540850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b3abc-4189-4d75-a794-ff6769fa9591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:18.550620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b3abc-4189-4d75-a794-ff6769fa9591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:18.552066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b3abc-4189-4d75-a794-ff6769fa9591 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:18.562498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1063/2109] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:18.614074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1714bee9c31a42b19b5c88dd7cb7361c', 'request_id': 'req-28bb4d98-8114-4075-897a-cc1d5b897b56'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.619694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1714bee9c31a42b19b5c88dd7cb7361c', 'request_id': 'req-28bb4d98-8114-4075-897a-cc1d5b897b56'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.765946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1714bee9c31a42b19b5c88dd7cb7361c', 'request_id': 'req-28bb4d98-8114-4075-897a-cc1d5b897b56'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.787105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] The token cache is being invalidate because project 1714bee9c31a42b19b5c88dd7cb7361c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:18.787632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.788909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-28bb4d98-8114-4075-897a-cc1d5b897b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:18.799209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7886-ffcb-4401-b981-6db8006038b9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:18.799209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7886-ffcb-4401-b981-6db8006038b9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:18.799209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7886-ffcb-4401-b981-6db8006038b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:18.799773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1047/2110] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:18 2021] DELETE /identity/v3/projects/1714bee9c31a42b19b5c88dd7cb7361c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:18.817111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e81a7886-ffcb-4401-b981-6db8006038b9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:18.818357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e81a7886-ffcb-4401-b981-6db8006038b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:18.930480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1064/2111] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:18.936931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0de3-98c6-4fc3-936e-45d0f255b957 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:18.937818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0de3-98c6-4fc3-936e-45d0f255b957 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:18.938141 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0de3-98c6-4fc3-936e-45d0f255b957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:18.973271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-da8a0de3-98c6-4fc3-936e-45d0f255b957 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:18.974909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-da8a0de3-98c6-4fc3-936e-45d0f255b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:18.990974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7886-ffcb-4401-b981-6db8006038b9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:18.991597 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1048/2112] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:19.007724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7886-ffcb-4401-b981-6db8006038b9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.015143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.016093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.020688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.020688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.020688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:19.020688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.020688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.048041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1065/2113] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:35:19.056323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a0de3-98c6-4fc3-936e-45d0f255b957 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:19.074061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a0de3-98c6-4fc3-936e-45d0f255b957 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.074061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.074061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.074061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.074548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.074833 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.076757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.146833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:19.148884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:19.174687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521f0b7-cd6c-43ec-b8b3-20c4a3c94790 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.198409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.215265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.215265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.215265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] PATH_INFO: `/v3/projects/87cdc904ce144e28acf3fd931ad34b34` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.215265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cdc904ce144e28acf3fd931ad34b34)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.215265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.218467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1049/2114] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:19 2021] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:19.223156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:19.395107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cdc904ce144e28acf3fd931ad34b34', 'request_id': 'req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.397521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64cc65-68c1-4966-8de1-779bfea2dc7b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.412415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cdc904ce144e28acf3fd931ad34b34', 'request_id': 'req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.488171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.569606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.569606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.569606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.569606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.569606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.683173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cdc904ce144e28acf3fd931ad34b34', 'request_id': 'req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.694443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] The token cache is being invalidate because project 87cdc904ce144e28acf3fd931ad34b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:19.702348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.702348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.702348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1066/2115] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:19 2021] DELETE /identity/v3/projects/87cdc904ce144e28acf3fd931ad34b34 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:19.706024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:19.707525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:19.721061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea5f61-4afd-45e6-b3b3-3e3e6ea68979 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.726318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.727172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.727454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.727727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] PATH_INFO: `/v3/users/450750ab45414874abde4574a07a3ab2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.728941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=450750ab45414874abde4574a07a3ab2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.730935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.778267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1050/2116] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:19 2021] POST /identity/v3/users => generated 286 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:19.783500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:19.785296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:19.797021 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ab5a6-75d9-4bba-b2ba-0748df529f0a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.802033 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.802845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.803130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.803409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.804205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.805807 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.817076 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1051/2117] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:19 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:19.828368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:19.831637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fb5a6-54df-48fa-b034-5251fb638dff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.836242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.836887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.837189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.837495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.838258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.839845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.853209 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1052/2118] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:19.860655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:19.864132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76862197-157d-4bcf-83eb-5144756f725d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:19.868817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a371e9b-25ce-465f-b08d-c79ce0c9288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:19.869678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371e9b-25ce-465f-b08d-c79ce0c9288d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:19.869955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371e9b-25ce-465f-b08d-c79ce0c9288d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:19.870256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371e9b-25ce-465f-b08d-c79ce0c9288d admin admin] PATH_INFO: `/v3/projects/3edf464ea72044b0a65dd300031d24b4/users/73c964b90fee4542ba1b742b4a0caa2a/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:19.903703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a371e9b-25ce-465f-b08d-c79ce0c9288d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edf464ea72044b0a65dd300031d24b4, user_id=73c964b90fee4542ba1b742b4a0caa2a, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:19.906438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a371e9b-25ce-465f-b08d-c79ce0c9288d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:19.933434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450750ab45414874abde4574a07a3ab2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.954027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450750ab45414874abde4574a07a3ab2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.954027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450750ab45414874abde4574a07a3ab2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.954027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450750ab45414874abde4574a07a3ab2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:19.961288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450750ab45414874abde4574a07a3ab2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:20.029065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1053/2119] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:19 2021] PUT /identity/v3/projects/3edf464ea72044b0a65dd300031d24b4/users/73c964b90fee4542ba1b742b4a0caa2a/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:20.034200 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:20.034521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:20.034800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:20.054723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:20.055935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:20.095195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1067/2120] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:19 2021] DELETE /identity/v3/users/450750ab45414874abde4574a07a3ab2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:20.135588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1054/2121] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:20.159295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:20.161107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:20.242972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdf477-1775-4025-a92e-8a9afa3656ff admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:20.247223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6969c6-c12e-4a7a-a539-c140dc502a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:20.247903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6969c6-c12e-4a7a-a539-c140dc502a8e service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:20.248190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6969c6-c12e-4a7a-a539-c140dc502a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:20.248468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6969c6-c12e-4a7a-a539-c140dc502a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:20.313106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6969c6-c12e-4a7a-a539-c140dc502a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:20.315737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6969c6-c12e-4a7a-a539-c140dc502a8e service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:20.325519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1068/2122] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:20.601402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:20.603240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:20.618711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd94b4-44ce-4e80-b241-9da519e63ffc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:20.624260 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:20.625246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:20.625602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:20.625956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] PATH_INFO: `/v3/projects/5d9c74c6a48d4894b17f6281bf2be18c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:20.627350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9c74c6a48d4894b17f6281bf2be18c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:20.629656 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:20.776383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9c74c6a48d4894b17f6281bf2be18c', 'request_id': 'req-cffb55f1-a72a-4359-a039-b627cee31d09'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:20.786024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9c74c6a48d4894b17f6281bf2be18c', 'request_id': 'req-cffb55f1-a72a-4359-a039-b627cee31d09'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:20.874797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9c74c6a48d4894b17f6281bf2be18c', 'request_id': 'req-cffb55f1-a72a-4359-a039-b627cee31d09'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:20.894113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] The token cache is being invalidate because project 5d9c74c6a48d4894b17f6281bf2be18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:20.894720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:20.896307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:20.907093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1055/2123] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:20 2021] DELETE /identity/v3/projects/5d9c74c6a48d4894b17f6281bf2be18c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:20.916485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db715-60de-49b3-b46b-411252d4dc55 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:20.916850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db715-60de-49b3-b46b-411252d4dc55 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:20.917132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db715-60de-49b3-b46b-411252d4dc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:20.935819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4e6db715-60de-49b3-b46b-411252d4dc55 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:20.940664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4e6db715-60de-49b3-b46b-411252d4dc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:21.015621 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1069/2124] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:21.019541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.022780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:21.030786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844231c-f5f5-48f8-8139-05a7f9da7b2a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.031207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844231c-f5f5-48f8-8139-05a7f9da7b2a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.031610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844231c-f5f5-48f8-8139-05a7f9da7b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.041278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb55f1-a72a-4359-a039-b627cee31d09 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.046358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.047234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.047552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.047885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] PATH_INFO: `/v3/users/00480a838cdc42198100c17f9081c0d5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.049197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00480a838cdc42198100c17f9081c0d5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.051231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.058983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b844231c-f5f5-48f8-8139-05a7f9da7b2a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:21.060247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b844231c-f5f5-48f8-8139-05a7f9da7b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:21.077956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1070/2125] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:21.082946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844231c-f5f5-48f8-8139-05a7f9da7b2a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.094360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844231c-f5f5-48f8-8139-05a7f9da7b2a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.100256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.101052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.101433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.101811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.102713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:21.103109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.105030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.117998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1071/2126] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:35:21.122110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.131799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220529cb-c9c0-41b2-8eec-fdf79a4c7168 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.136583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.138059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.138059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.138059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.138653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.140599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.261081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00480a838cdc42198100c17f9081c0d5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:21.261749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00480a838cdc42198100c17f9081c0d5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:21.274402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00480a838cdc42198100c17f9081c0d5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:21.275065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00480a838cdc42198100c17f9081c0d5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:21.300526 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1072/2127] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:21 2021] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:21.304671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.306373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:21.372341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb5034-9e53-4589-ba9d-148270ddf01f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.380003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b0a35ce1-b893-47ea-b989-ff494aa54af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00480a838cdc42198100c17f9081c0d5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:21.380109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.380109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.380109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.380109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.380389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.382712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.418093 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1056/2128] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:21 2021] DELETE /identity/v3/users/00480a838cdc42198100c17f9081c0d5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:21.423445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.424681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.425144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.444383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:21.445640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:21.481664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1073/2129] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:21 2021] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:21.482780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.494605 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bee88-a9a9-4f8c-bd02-27670fb4cd5c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.525275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1057/2130] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:21.544318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.546524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:21.565546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.566685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.566971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.567247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.568406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.570050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.580047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1074/2131] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:21 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:21.585224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.594848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df3db-aef7-498d-b362-689fffad9927 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.600274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.600930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.601218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.601497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.602272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.603864 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.607766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617599-118a-4a59-84e4-37feff56b706 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.613909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d954e-13c6-4c60-a78e-413e6b4f98a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.615474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1075/2132] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:21.615606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d954e-13c6-4c60-a78e-413e6b4f98a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.615606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d954e-13c6-4c60-a78e-413e6b4f98a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.615606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d954e-13c6-4c60-a78e-413e6b4f98a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.618630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:21.625788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d954e-13c6-4c60-a78e-413e6b4f98a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.627933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d954e-13c6-4c60-a78e-413e6b4f98a7 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.628550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d9c75-fa06-4553-b9bf-746ea1d257fe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:21.633569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:21.634484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.634826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.635126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] PATH_INFO: `/v3/projects/9b6f26067aeb4dd6a224afe26b599493/users/d7ed87d04ef4485498def4249f52c896/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.637922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1058/2133] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:21.650621 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6f26067aeb4dd6a224afe26b599493, user_id=d7ed87d04ef4485498def4249f52c896, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:21.653266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:21.783429 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1076/2134] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:21 2021] PUT /identity/v3/projects/9b6f26067aeb4dd6a224afe26b599493/users/d7ed87d04ef4485498def4249f52c896/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:21.794919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d139-3469-41c8-8678-6cb24df6d982 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:21.795410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d139-3469-41c8-8678-6cb24df6d982 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:21.795508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5d139-3469-41c8-8678-6cb24df6d982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:21.833877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fed5d139-3469-41c8-8678-6cb24df6d982 None None] MFA Rules not processed for user `d7ed87d04ef4485498def4249f52c896`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:21.835153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fed5d139-3469-41c8-8678-6cb24df6d982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:21.925311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1059/2135] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:21.926371 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.100527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f2c7c-021e-4816-871e-68c90664a35d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.110940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.114377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.114670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.114954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.116438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.119496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.190862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.191707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.192215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.235426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1077/2136] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:21 2021] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:22.239163 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.242004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] MFA Rules not processed for user `73c964b90fee4542ba1b742b4a0caa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:22.243464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:22.334420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1060/2137] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:22 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:22.334420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.336000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:22.349921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d54d7-7098-4cc5-bc89-0925d7e943a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.351994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.352991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.353283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.353557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.354298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.356352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.377303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db950616-e0eb-4d21-a761-97353f88bdaa None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.384263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.385301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.385732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.386234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] PATH_INFO: `/v3/projects/e66d44d5a63742bda1a43b611060be2f` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.388506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66d44d5a63742bda1a43b611060be2f)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.390686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.467705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1078/2138] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:22 2021] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:22.467705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.467705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:22.541658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66d44d5a63742bda1a43b611060be2f', 'request_id': 'req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.547477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1590f-9cbb-4093-a1f7-feaf6fcd5238 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.547847 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66d44d5a63742bda1a43b611060be2f', 'request_id': 'req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.599161 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.600253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.600545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.600824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.623099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66d44d5a63742bda1a43b611060be2f', 'request_id': 'req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.635735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] The token cache is being invalidate because project e66d44d5a63742bda1a43b611060be2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:22.636056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.636998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.638829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1061/2139] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:22 2021] DELETE /identity/v3/projects/e66d44d5a63742bda1a43b611060be2f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:22.639579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.641112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:22.662776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.663774 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.673845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1079/2140] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:22 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:22.675004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.729562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c76fec-d1b4-47c4-b2b1-840f677d5d1c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.737506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.737921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.738335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.738619 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.739400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.741068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.752871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1062/2141] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:22 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:22.755659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd516e7e-03a2-428f-837c-3e7df6fb0251 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.757684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.761354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.762258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.762545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.763651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] PATH_INFO: `/v3/users/dc79596fc1184ba0a77a799958f2d93c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.764932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc79596fc1184ba0a77a799958f2d93c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.767997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.769689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f209-f005-40c4-8576-42698f15d0d9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.775530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.776197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.776485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.776765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.777637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.779323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.790130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1063/2142] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:22.794061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:22.806428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6930042-7eef-4336-82c8-6c6351fc8f6f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:22.812159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118752e8-f13d-49b8-b398-160c0f2dd229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:22.813054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118752e8-f13d-49b8-b398-160c0f2dd229 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.813336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118752e8-f13d-49b8-b398-160c0f2dd229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.813611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118752e8-f13d-49b8-b398-160c0f2dd229 admin admin] PATH_INFO: `/v3/projects/b20886e373e74050b6a445544775f8be/users/e637d14c204a4339bacd8a033ea581f8/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.839384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118752e8-f13d-49b8-b398-160c0f2dd229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20886e373e74050b6a445544775f8be, user_id=e637d14c204a4339bacd8a033ea581f8, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:22.842721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118752e8-f13d-49b8-b398-160c0f2dd229 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:22.945070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1064/2143] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:22 2021] PUT /identity/v3/projects/b20886e373e74050b6a445544775f8be/users/e637d14c204a4339bacd8a033ea581f8/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:22.953766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc79596fc1184ba0a77a799958f2d93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.961255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:22.961255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:22.961255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:22.967912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc79596fc1184ba0a77a799958f2d93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.968733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc79596fc1184ba0a77a799958f2d93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.970023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc79596fc1184ba0a77a799958f2d93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.977681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc79596fc1184ba0a77a799958f2d93c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:22.989977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] MFA Rules not processed for user `e637d14c204a4339bacd8a033ea581f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:22.991290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:23.056607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1065/2144] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:23.064486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.066114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:23.142602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216492ef-4e1f-41a2-a2ec-cc15fc671670 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:23.148400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:23.150690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:23.150690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:23.150690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:23.150969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1080/2145] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:22 2021] DELETE /identity/v3/users/dc79596fc1184ba0a77a799958f2d93c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:23.151408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:23.152071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.152434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:23.154417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:23.246636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027354-e402-4f64-9381-a92cd399d412 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:23.252356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:23.253105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:23.253457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:23.253805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] PATH_INFO: `/v3/users/aa2ff7cc84b44ea688c3a55ca4989ce0` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:23.255159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2ff7cc84b44ea688c3a55ca4989ce0)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:23.257319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:23.295869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1066/2146] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:23 2021] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:23.300381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.373514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295370-f947-44bd-bef6-491212e15a0f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:23.386574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:23.386938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:23.387224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:23.394689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:23.399706 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:23.402729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:23.502139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2ff7cc84b44ea688c3a55ca4989ce0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:23.520277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1067/2147] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:23 2021] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:23.523241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2ff7cc84b44ea688c3a55ca4989ce0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:23.524091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.526476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:23.527057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2ff7cc84b44ea688c3a55ca4989ce0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:23.527704 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2ff7cc84b44ea688c3a55ca4989ce0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:23.555011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bc6f6f7d-ec8f-4e6c-a3b4-4446dc2c821c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2ff7cc84b44ea688c3a55ca4989ce0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:23.558159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825ead8-a6cf-4243-872e-c1c442bb49ad admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:23.573181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:23.574366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:23.574843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:23.575394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:23.586197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:23.598873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:23.639364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1068/2148] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:23 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:23.647947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.672856 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1081/2149] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:23 2021] DELETE /identity/v3/users/aa2ff7cc84b44ea688c3a55ca4989ce0 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:23.673138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b30fc-d0a7-4a2c-ac88-f9656da8a4c7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:23.683474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:23.683867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:23.684254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:23.713123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:23.714538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:23.795795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:23.797657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:23.798289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:23.799149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] PATH_INFO: `/v3/projects/7b2c5606c061415bac91f2be2d152744/users/4bdadbad98034052a3f7cfd6c1f25902/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:23.803849 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1082/2150] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:23.816128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.817858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:23.826935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2c5606c061415bac91f2be2d152744, user_id=4bdadbad98034052a3f7cfd6c1f25902, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:23.829676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:23.931913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80188b-ca9e-4843-b614-fa417c6c036c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:23.940394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:23.941301 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:23.944341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:23.944341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:23.948963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1069/2151] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:23 2021] PUT /identity/v3/projects/7b2c5606c061415bac91f2be2d152744/users/4bdadbad98034052a3f7cfd6c1f25902/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:23.948963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.949264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:23.956729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:23.958159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:23.968660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1083/2152] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:23.969840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:23.980408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839916c3-e298-482a-ba6f-75e46345943f service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.044868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:24.045535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.052444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.052444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.052444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:24.052444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:24.059783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1084/2153] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:23 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:24.064629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:24.066700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85203d1-19fa-4fc6-8c55-d5c060d80148 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.073566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:24.074882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.075440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.075553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3db91-bc12-4afb-87b5-179ff90d274f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.075809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] PATH_INFO: `/v3/projects/0e15adc3a38a4c39afdc2d1645579488` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.077277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e15adc3a38a4c39afdc2d1645579488)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:24.080440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:24.083384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e29cc-a484-4e43-bcb1-6f53e641af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:24.090867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e29cc-a484-4e43-bcb1-6f53e641af44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.091251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e29cc-a484-4e43-bcb1-6f53e641af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.091591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e29cc-a484-4e43-bcb1-6f53e641af44 admin admin] PATH_INFO: `/v3/projects/7b2c5606c061415bac91f2be2d152744/users/4bdadbad98034052a3f7cfd6c1f25902/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.094533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e29cc-a484-4e43-bcb1-6f53e641af44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2c5606c061415bac91f2be2d152744, user_id=4bdadbad98034052a3f7cfd6c1f25902, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:24.097896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e29cc-a484-4e43-bcb1-6f53e641af44 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:24.110580 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1085/2154] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:24 2021] PUT /identity/v3/projects/7b2c5606c061415bac91f2be2d152744/users/4bdadbad98034052a3f7cfd6c1f25902/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:24.121478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.121771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.122121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.153168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] MFA Rules not processed for user `4bdadbad98034052a3f7cfd6c1f25902`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:24.154479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.226009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e15adc3a38a4c39afdc2d1645579488', 'request_id': 'req-62a49792-881c-4552-bdfc-4d74855135d1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.238814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e15adc3a38a4c39afdc2d1645579488', 'request_id': 'req-62a49792-881c-4552-bdfc-4d74855135d1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.248125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1086/2155] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:24 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:24.259574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:24.261405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.302698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e15adc3a38a4c39afdc2d1645579488', 'request_id': 'req-62a49792-881c-4552-bdfc-4d74855135d1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.320658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] The token cache is being invalidate because project 0e15adc3a38a4c39afdc2d1645579488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:24.321327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.322364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-62a49792-881c-4552-bdfc-4d74855135d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.326040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1070/2156] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:23 2021] DELETE /identity/v3/projects/0e15adc3a38a4c39afdc2d1645579488 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:24.331994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb9b3-889b-4fc2-87d8-74f41abd5a35 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.332756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb9b3-889b-4fc2-87d8-74f41abd5a35 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.333113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb9b3-889b-4fc2-87d8-74f41abd5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.351656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd66bb-97dd-4647-9f70-89610f1834e5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.354012 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cc5bb9b3-889b-4fc2-87d8-74f41abd5a35 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:24.355456 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cc5bb9b3-889b-4fc2-87d8-74f41abd5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.431542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:24.432360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.432694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.433048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.435190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.438341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1071/2157] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:24.440782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5b4b-9578-48d2-a88f-5bac63cd0df0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.441330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5b4b-9578-48d2-a88f-5bac63cd0df0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.441709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5b4b-9578-48d2-a88f-5bac63cd0df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.466343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4dbe5b4b-9578-48d2-a88f-5bac63cd0df0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:24.467960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4dbe5b4b-9578-48d2-a88f-5bac63cd0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.480566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1072/2158] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:24.485409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5b4b-9578-48d2-a88f-5bac63cd0df0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:24.497771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5b4b-9578-48d2-a88f-5bac63cd0df0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.515305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:24.517204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:24.523762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:24.524532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.525013 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.525364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.526255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:24.527296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:24.528815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:24.530086 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1087/2159] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:24 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:24.531114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:24.534266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.561445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46007317-1c05-4192-8b28-83287c106819 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.570395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1073/2160] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:24.571632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:24.575860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:24.576836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.577207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.578267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] PATH_INFO: `/v3/projects/a80f23f1f7e54d86a73be3c20979581b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.579008 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80f23f1f7e54d86a73be3c20979581b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:24.582257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:24.608362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec23ab-66e6-44df-afe7-d92ece777c67 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.619129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df742eaa-c834-47fd-b00f-1cba6a87e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:24.620783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df742eaa-c834-47fd-b00f-1cba6a87e938 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.621079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df742eaa-c834-47fd-b00f-1cba6a87e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.621363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df742eaa-c834-47fd-b00f-1cba6a87e938 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.624335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df742eaa-c834-47fd-b00f-1cba6a87e938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:24.630621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df742eaa-c834-47fd-b00f-1cba6a87e938 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:24.733891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80f23f1f7e54d86a73be3c20979581b', 'request_id': 'req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.743287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80f23f1f7e54d86a73be3c20979581b', 'request_id': 'req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.759858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1074/2161] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:24 2021] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:24.761262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970da5-dc54-48d4-8f4d-969194b28520 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.761686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970da5-dc54-48d4-8f4d-969194b28520 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.762062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970da5-dc54-48d4-8f4d-969194b28520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.781205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a9970da5-dc54-48d4-8f4d-969194b28520 None None] MFA Rules not processed for user `73c964b90fee4542ba1b742b4a0caa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:24.782492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a9970da5-dc54-48d4-8f4d-969194b28520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.816417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80f23f1f7e54d86a73be3c20979581b', 'request_id': 'req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.835246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] The token cache is being invalidate because project a80f23f1f7e54d86a73be3c20979581b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:24.835644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.836327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:24.838386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1088/2162] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:24 2021] DELETE /identity/v3/projects/a80f23f1f7e54d86a73be3c20979581b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:24.847393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:24.852846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.865621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1075/2163] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:24 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:24.866701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:24.875421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:24.875421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:24.910112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:24.912882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:24.949479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e462bf1-6694-4636-9d1d-90bfd6d1cb47 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:24.992574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1076/2164] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:24.992574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:24.992574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:25.002710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33750b-6d9c-4f8f-a4fd-d21597349203 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.008846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.010347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.010707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.011061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] PATH_INFO: `/v3/users/3eed219194494c3187d8db99ea7cdbb4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.012447 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eed219194494c3187d8db99ea7cdbb4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.014498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.023302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7131-356b-41e9-a898-44b3c433fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.025320 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7131-356b-41e9-a898-44b3c433fa2b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.025606 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7131-356b-41e9-a898-44b3c433fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.026071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7131-356b-41e9-a898-44b3c433fa2b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.026819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7131-356b-41e9-a898-44b3c433fa2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.029409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7131-356b-41e9-a898-44b3c433fa2b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.121274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1089/2165] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:24 2021] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:25.122760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a93-891c-42a0-9452-967aec961ecb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.123046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a93-891c-42a0-9452-967aec961ecb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.123321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a93-891c-42a0-9452-967aec961ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.143033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-33028a93-891c-42a0-9452-967aec961ecb None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:25.144541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-33028a93-891c-42a0-9452-967aec961ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:25.155398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1090/2166] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:25.162166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33028a93-891c-42a0-9452-967aec961ecb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.172315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33028a93-891c-42a0-9452-967aec961ecb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.177620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.178321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.178599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.178866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.179612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.181304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.194465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1091/2167] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:25 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:25.194465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.203701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b109f-19f9-414c-a598-5f48cfab4584 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.209068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.209835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.210032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.210348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.211232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:25.211544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.213190 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.225894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1092/2168] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:25.226630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.236623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe979c4-fe70-4536-a8bc-2cfcda962271 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.241670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.242344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.242622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.243027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.243807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.245376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.258367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1093/2169] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:25.259173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.269684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eed219194494c3187d8db99ea7cdbb4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:25.270427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eed219194494c3187d8db99ea7cdbb4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:25.277778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e17a2c-e4e8-4f60-bbc2-d6374bf80c07 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.285562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.285562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.295185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.295185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.295185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.295185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.295509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eed219194494c3187d8db99ea7cdbb4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:25.299572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eed219194494c3187d8db99ea7cdbb4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:25.380492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eed219194494c3187d8db99ea7cdbb4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:25.400174 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1077/2171] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:24 2021] DELETE /identity/v3/users/3eed219194494c3187d8db99ea7cdbb4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:25.400361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1094/2171] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:25 2021] POST /identity/v3/projects => generated 397 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:25.400462 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.401405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:25.401541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.408702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:25.483461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f0778-eb76-4fa6-85c6-3553d1a1edce admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.484618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e058e94-b549-48aa-8d34-efa6eb3a179f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.488560 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4950-cbbe-4681-bb7b-9da750240b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.489311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4950-cbbe-4681-bb7b-9da750240b15 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.489551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4950-cbbe-4681-bb7b-9da750240b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.490260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4950-cbbe-4681-bb7b-9da750240b15 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.490372 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.491099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4950-cbbe-4681-bb7b-9da750240b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.491258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.491638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.491990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] PATH_INFO: `/v3/projects/6bde03cb03864d69ad30ce991e8049b8/users/d4de1167a2df4ac2aadc20318fd13154/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.492612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4950-cbbe-4681-bb7b-9da750240b15 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.507956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bde03cb03864d69ad30ce991e8049b8, user_id=d4de1167a2df4ac2aadc20318fd13154, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.510638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.596003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1095/2172] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:25 2021] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:25.596003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6954f-6745-41a7-9fb2-39916977f990 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.596003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6954f-6745-41a7-9fb2-39916977f990 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.596003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6954f-6745-41a7-9fb2-39916977f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.600346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1078/2173] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:25 2021] PUT /identity/v3/projects/6bde03cb03864d69ad30ce991e8049b8/users/d4de1167a2df4ac2aadc20318fd13154/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:25.600509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.620762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-44a6954f-6745-41a7-9fb2-39916977f990 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:25.621983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-44a6954f-6745-41a7-9fb2-39916977f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:25.690648 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1096/2174] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:25.692435 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf007ae-0ad2-4e4e-bdd7-bba3c64dac37 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.692897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf007ae-0ad2-4e4e-bdd7-bba3c64dac37 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.693223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf007ae-0ad2-4e4e-bdd7-bba3c64dac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.706566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b0967-6088-4603-9778-5d434da4e9f5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.714395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.715634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.716069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.716421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.717326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.719384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.725269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-abf007ae-0ad2-4e4e-bdd7-bba3c64dac37 None None] MFA Rules not processed for user `d4de1167a2df4ac2aadc20318fd13154`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:25.726579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-abf007ae-0ad2-4e4e-bdd7-bba3c64dac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:25.733014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1079/2175] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:25 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:25.735514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.738626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:25.807153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3492b1-1af1-4367-ace2-a369fb607799 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.811164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.811822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.812109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.812388 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.816528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1097/2176] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:25.818137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf007ae-0ad2-4e4e-bdd7-bba3c64dac37 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.825550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.827032 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.840082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1080/2177] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:25.840991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.849203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf007ae-0ad2-4e4e-bdd7-bba3c64dac37 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.852528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09add40-317a-4ca1-bd3b-1c3b1a61de7a service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.854103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.855149 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.855439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.855822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.856950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.858316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.858936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.859156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.859515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.859994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.860652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.863476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.877373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1098/2178] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:25 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:25.878366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:25.890942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f0b2d-3eec-46a2-b1cd-45e6451210dd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:25.898211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aff1b8-8556-4b35-b00c-280d32d66477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:25.901001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff1b8-8556-4b35-b00c-280d32d66477 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:25.901001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff1b8-8556-4b35-b00c-280d32d66477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:25.901001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aff1b8-8556-4b35-b00c-280d32d66477 admin admin] PATH_INFO: `/v3/projects/32d6e6317dd94d67bc59921dab36f93f/users/761cc0749ca1481db3142436b42feac3/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:25.918618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aff1b8-8556-4b35-b00c-280d32d66477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d6e6317dd94d67bc59921dab36f93f, user_id=761cc0749ca1481db3142436b42feac3, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:25.921401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aff1b8-8556-4b35-b00c-280d32d66477 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:25.978046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1081/2179] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:25 2021] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:25.979877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.025438 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1099/2180] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:25 2021] PUT /identity/v3/projects/32d6e6317dd94d67bc59921dab36f93f/users/761cc0749ca1481db3142436b42feac3/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:26.035566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.035941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.036220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.068282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] MFA Rules not processed for user `761cc0749ca1481db3142436b42feac3`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:26.069944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:26.093110 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e538-6318-41f2-8511-01241ed03a4a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.170267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.171029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.171378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.171715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.172579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:26.176355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:26.200601 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1100/2181] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:26.210848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.212348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:26.283136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1082/2182] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:25 2021] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:26.284713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.297390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d37e73-71dc-4a22-bfcf-be88532bb74e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.304686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.305526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.306084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.306481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.307780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:26.309696 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:26.315620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a368c-0ca0-472c-80dc-e764f25b94aa None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.322105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.322810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.331454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.331454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.331665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1083/2183] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:26 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:26.332719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.334522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:26.336024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:26.345982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ba4c-a878-4879-8704-dd2c8fb1531d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.349080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1101/2184] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:26 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:26.353029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.358122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.358122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.358122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] PATH_INFO: `/v3/projects/38eeeae02898421bbc19e201ec29ce5b/users/8fbb2feaa423412388f9626aaed12875/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.381244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38eeeae02898421bbc19e201ec29ce5b, user_id=8fbb2feaa423412388f9626aaed12875, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:26.381244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:26.463851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1084/2185] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:26 2021] PUT /identity/v3/projects/38eeeae02898421bbc19e201ec29ce5b/users/8fbb2feaa423412388f9626aaed12875/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:26.468097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.484857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cd2f7-89ef-437c-919e-59b5bcdc63e4 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.537786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.540419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:26.607107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.608270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.609730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.609730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.610296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:26.612768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:26.632587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1102/2186] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:26 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:26.636576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.664736 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024015-f8ad-4f50-8a55-f228df93efce admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.665156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689fb72-0663-4812-9c59-c7b48f5d04f1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.670409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6275eca-e26a-4af8-b682-8d9f4fa3bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.671307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275eca-e26a-4af8-b682-8d9f4fa3bb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.672303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275eca-e26a-4af8-b682-8d9f4fa3bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.672498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6275eca-e26a-4af8-b682-8d9f4fa3bb6b admin admin] PATH_INFO: `/v3/projects/38eeeae02898421bbc19e201ec29ce5b/users/8fbb2feaa423412388f9626aaed12875/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.675971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.677397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.677945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.678293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275eca-e26a-4af8-b682-8d9f4fa3bb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38eeeae02898421bbc19e201ec29ce5b, user_id=8fbb2feaa423412388f9626aaed12875, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:26.678908 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] PATH_INFO: `/v3/projects/6a01708ed98b42e6b8bd3cf784e5f0e9` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.680710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a01708ed98b42e6b8bd3cf784e5f0e9)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:26.682899 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:26.697336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6275eca-e26a-4af8-b682-8d9f4fa3bb6b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:26.719495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1103/2187] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:26 2021] PUT /identity/v3/projects/38eeeae02898421bbc19e201ec29ce5b/users/8fbb2feaa423412388f9626aaed12875/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:26.731770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.731770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.736379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.759572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] MFA Rules not processed for user `8fbb2feaa423412388f9626aaed12875`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:26.760766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:26.791866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a01708ed98b42e6b8bd3cf784e5f0e9', 'request_id': 'req-c12d7505-5a98-492e-abf2-0c28bb5f6493'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:26.797042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a01708ed98b42e6b8bd3cf784e5f0e9', 'request_id': 'req-c12d7505-5a98-492e-abf2-0c28bb5f6493'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:26.830277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1104/2188] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:26 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:26.831229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:26.832553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:26.874222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a01708ed98b42e6b8bd3cf784e5f0e9', 'request_id': 'req-c12d7505-5a98-492e-abf2-0c28bb5f6493'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:26.889180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4604b6-b4d1-4add-ba10-daad54dc6fdb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:26.889590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] The token cache is being invalidate because project 6a01708ed98b42e6b8bd3cf784e5f0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:26.890067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:26.891091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:26.893839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1085/2189] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:26 2021] DELETE /identity/v3/projects/6a01708ed98b42e6b8bd3cf784e5f0e9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:26.946763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:26.947423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:26.947708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:26.947981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:26.950061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:27.013055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:27.014565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:27.025959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1105/2190] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:26 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:27.358923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:27.360530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:27.373533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d7505-5a98-492e-abf2-0c28bb5f6493 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:27.377798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:27.378531 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:27.378812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:27.380065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:27.381803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:27.441119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:27.442663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:27.451405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1086/2191] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:27 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:28.847748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:28.849350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:28.860686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a71c9-5d79-497d-9912-2578dcc359d6 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:28.865434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:28.866338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:28.866644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:28.867090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:28.868901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:28.939449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:28.941325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:28.951262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1106/2192] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:28 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:34.996051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:35.004853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54a24a-6382-4631-9b3f-4dab88b1390a service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:35.008576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:35.009202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:35.009573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:35.009740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:35.011527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:35.074836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:35.076274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:35.086427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1087/2193] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:34 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:35.860004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:35.861981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:35.955284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621146-14dd-47d8-a820-038bb9f88525 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:35.960164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:35.961033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:35.961321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:35.962812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] PATH_INFO: `/v3/users/761cc0749ca1481db3142436b42feac3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:35.962928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=761cc0749ca1481db3142436b42feac3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:35.964888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:36.167496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761cc0749ca1481db3142436b42feac3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.180072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761cc0749ca1481db3142436b42feac3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.180765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761cc0749ca1481db3142436b42feac3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.181527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761cc0749ca1481db3142436b42feac3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.189628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a02769e-7ebf-4217-b961-f846cade9cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761cc0749ca1481db3142436b42feac3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.244776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:36.246279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:36.261370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3dbe3-dd96-4d0c-a1a7-f50d6b21b2e4 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:36.263853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1107/2194] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:35 2021] DELETE /identity/v3/users/761cc0749ca1481db3142436b42feac3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:36.269074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:36.270363 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:36.270634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:36.270755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:36.270939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] PATH_INFO: `/v3/users/d7ed87d04ef4485498def4249f52c896` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:36.271039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:36.271225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:36.272312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ed87d04ef4485498def4249f52c896)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:36.274239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:36.288827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:36.290226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:36.350023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1108/2195] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:36.359659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:36.362278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:36.419423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ae39-2f28-4a47-b5c8-45b2866c9659 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:36.423137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3737e-c1f0-4c94-b4db-dfe2529af114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:36.424873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3737e-c1f0-4c94-b4db-dfe2529af114 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:36.425157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3737e-c1f0-4c94-b4db-dfe2529af114 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:36.425436 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3737e-c1f0-4c94-b4db-dfe2529af114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:36.434806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3737e-c1f0-4c94-b4db-dfe2529af114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:36.436236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3737e-c1f0-4c94-b4db-dfe2529af114 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:36.446331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1109/2196] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:36.475064 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ed87d04ef4485498def4249f52c896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.475818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ed87d04ef4485498def4249f52c896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.489538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ed87d04ef4485498def4249f52c896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.490279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ed87d04ef4485498def4249f52c896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.557044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ed87d04ef4485498def4249f52c896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:36.569970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1088/2197] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:36 2021] DELETE /identity/v3/users/d7ed87d04ef4485498def4249f52c896 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:36.574485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:36.574800 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:36.575078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:36.592691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:36.593896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:36.668771 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1110/2198] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:36.677289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:36.678831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:36.745252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af8063-54b9-4f33-a381-a581362c9604 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:36.751340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615a68-87e4-4502-b591-600d506f08dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:36.752114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615a68-87e4-4502-b591-600d506f08dd service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:36.752873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615a68-87e4-4502-b591-600d506f08dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:36.752873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615a68-87e4-4502-b591-600d506f08dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:36.763185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64615a68-87e4-4502-b591-600d506f08dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:36.764644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64615a68-87e4-4502-b591-600d506f08dd service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:36.776140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1089/2199] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:36.907898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:36.909535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:36.921014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096e9b-e8e7-45fb-9639-9bc79f61bb6c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:36.927698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:36.928815 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:36.929316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:36.929778 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] PATH_INFO: `/v3/projects/32d6e6317dd94d67bc59921dab36f93f` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:36.931595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d6e6317dd94d67bc59921dab36f93f)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:36.934307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.088471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d6e6317dd94d67bc59921dab36f93f', 'request_id': 'req-8581c303-a429-480d-afed-b0e37acafbba'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.094772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d6e6317dd94d67bc59921dab36f93f', 'request_id': 'req-8581c303-a429-480d-afed-b0e37acafbba'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.179725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d6e6317dd94d67bc59921dab36f93f', 'request_id': 'req-8581c303-a429-480d-afed-b0e37acafbba'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.192813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] The token cache is being invalidate because project 32d6e6317dd94d67bc59921dab36f93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:37.193393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.194527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8581c303-a429-480d-afed-b0e37acafbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.203036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1111/2200] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:36 2021] DELETE /identity/v3/projects/32d6e6317dd94d67bc59921dab36f93f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:37.206481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.206781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.207062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.247545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:37.248990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:37.352115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1090/2201] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:37.361331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e33c8-8373-476a-bbc6-dc37496b9cb1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.361331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e33c8-8373-476a-bbc6-dc37496b9cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.361331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e33c8-8373-476a-bbc6-dc37496b9cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.364162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.366050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:37.378232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ac9de-e68c-43b0-9405-f5dc3f7ec245 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.383137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.384136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.384470 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.384802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] PATH_INFO: `/v3/projects/9b6f26067aeb4dd6a224afe26b599493` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.386046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6f26067aeb4dd6a224afe26b599493)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.388024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.397743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-778e33c8-8373-476a-bbc6-dc37496b9cb1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:37.399140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-778e33c8-8373-476a-bbc6-dc37496b9cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:37.426126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1112/2202] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:37.432972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e33c8-8373-476a-bbc6-dc37496b9cb1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.443166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e33c8-8373-476a-bbc6-dc37496b9cb1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.447813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.448465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.448745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.449017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.449791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:37.450094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.451741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.464888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1113/2203] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:35:37.469046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.479429 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11673790-80b7-4a00-869a-15ae7fe98ed2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.484925 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.485586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.486453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.486821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.487486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.489377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.523360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6f26067aeb4dd6a224afe26b599493', 'request_id': 'req-42f5337d-d06c-474d-95b8-aa9bc7f08d99'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.528779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6f26067aeb4dd6a224afe26b599493', 'request_id': 'req-42f5337d-d06c-474d-95b8-aa9bc7f08d99'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.619717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6f26067aeb4dd6a224afe26b599493', 'request_id': 'req-42f5337d-d06c-474d-95b8-aa9bc7f08d99'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.631544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1114/2204] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:37 2021] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:37.635140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.637362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] The token cache is being invalidate because project 9b6f26067aeb4dd6a224afe26b599493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:37.637670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.638411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.644779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1091/2205] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:37 2021] DELETE /identity/v3/projects/9b6f26067aeb4dd6a224afe26b599493 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:37.654324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.659011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:37.746451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647398e-d354-43df-81eb-463da6c1400a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.752602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.753473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.753761 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.754035 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.754775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.756790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.769747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5337d-d06c-474d-95b8-aa9bc7f08d99 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.774877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.775846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.776128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.776472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] PATH_INFO: `/v3/users/e637d14c204a4339bacd8a033ea581f8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.777713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e637d14c204a4339bacd8a033ea581f8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.779715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.863801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1115/2206] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:37 2021] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:37.867875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.869521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:37.884660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c9b2-241c-455b-a901-40e3a445e205 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.889699 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.890427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.890738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.891049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.892406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.894219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.904755 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1116/2207] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:37 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:37.909410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.919413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678763d-9a7c-4e82-b5e9-4d7553b5e96c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.924775 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.925462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.925749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.926028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.927043 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.931810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.942593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1117/2208] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:35:37.946726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:37.958376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0c654-9a50-4873-82ef-4ba814eee4d5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:37.963772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857895e-4341-4e84-80b9-bd8c9ed17708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:37.964691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857895e-4341-4e84-80b9-bd8c9ed17708 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:37.964978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857895e-4341-4e84-80b9-bd8c9ed17708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:37.965250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857895e-4341-4e84-80b9-bd8c9ed17708 admin admin] PATH_INFO: `/v3/projects/46c64d4006bf47da9db3f2d198218d91/users/556ba510e962446888479f57eb098555/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:37.974172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e637d14c204a4339bacd8a033ea581f8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.975325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e637d14c204a4339bacd8a033ea581f8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.984520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857895e-4341-4e84-80b9-bd8c9ed17708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c64d4006bf47da9db3f2d198218d91, user_id=556ba510e962446888479f57eb098555, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:37.989964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857895e-4341-4e84-80b9-bd8c9ed17708 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:37.992240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e637d14c204a4339bacd8a033ea581f8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:37.993375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e637d14c204a4339bacd8a033ea581f8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:38.143459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1118/2209] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:37 2021] PUT /identity/v3/projects/46c64d4006bf47da9db3f2d198218d91/users/556ba510e962446888479f57eb098555/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:38.148419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:38.148704 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:38.148979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:38.165587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:38.166714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:38.171099 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e637d14c204a4339bacd8a033ea581f8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:38.186097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1092/2210] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:37 2021] DELETE /identity/v3/users/e637d14c204a4339bacd8a033ea581f8 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:38.227170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1119/2211] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:38.237985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:38.239440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:38.297478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0dfc4-0ebe-40a3-8477-9cc1a319ec4b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:38.301826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:38.302508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:38.302799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:38.303075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:38.365814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:38.367322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:38.380037 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1093/2212] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:38.653500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:38.654998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:38.668309 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcfc74-7960-4813-a482-10b78ea52586 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:38.674986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:38.675779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:38.676059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:38.676482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] PATH_INFO: `/v3/projects/b20886e373e74050b6a445544775f8be` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:38.677808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20886e373e74050b6a445544775f8be)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:38.680036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:38.824959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20886e373e74050b6a445544775f8be', 'request_id': 'req-67629d2b-6d54-4867-bd95-9db5e9e3f38c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:38.835972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20886e373e74050b6a445544775f8be', 'request_id': 'req-67629d2b-6d54-4867-bd95-9db5e9e3f38c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:38.960367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20886e373e74050b6a445544775f8be', 'request_id': 'req-67629d2b-6d54-4867-bd95-9db5e9e3f38c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:38.973726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] The token cache is being invalidate because project b20886e373e74050b6a445544775f8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:38.974014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:38.974690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:38.976224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1120/2213] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:38 2021] DELETE /identity/v3/projects/b20886e373e74050b6a445544775f8be => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:38.980218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:38.990006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa600761-b64f-4b7d-ab9e-1b974cb93f34 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:39.057827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:39.058794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:39.059073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:39.059345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] PATH_INFO: `/v3/users/4bdadbad98034052a3f7cfd6c1f25902` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:39.060678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bdadbad98034052a3f7cfd6c1f25902)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:39.062989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:39.256625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bdadbad98034052a3f7cfd6c1f25902'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:39.257685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bdadbad98034052a3f7cfd6c1f25902'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:39.271147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bdadbad98034052a3f7cfd6c1f25902'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:39.271946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bdadbad98034052a3f7cfd6c1f25902'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:39.365278 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-91372d48-b24d-4dbc-83ac-bf6be7a65da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bdadbad98034052a3f7cfd6c1f25902'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:39.380733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1094/2214] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:38 2021] DELETE /identity/v3/users/4bdadbad98034052a3f7cfd6c1f25902 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:39.784396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:39.785962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:39.800881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629d2b-6d54-4867-bd95-9db5e9e3f38c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:39.873322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:39.874290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:39.874576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:39.874850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] PATH_INFO: `/v3/projects/7b2c5606c061415bac91f2be2d152744` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:39.876091 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2c5606c061415bac91f2be2d152744)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:39.878501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:40.069255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2c5606c061415bac91f2be2d152744', 'request_id': 'req-d31d1c91-a0c6-4e5f-b024-f22276049d0e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:40.076748 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2c5606c061415bac91f2be2d152744', 'request_id': 'req-d31d1c91-a0c6-4e5f-b024-f22276049d0e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:40.192196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2c5606c061415bac91f2be2d152744', 'request_id': 'req-d31d1c91-a0c6-4e5f-b024-f22276049d0e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:40.204411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] The token cache is being invalidate because project 7b2c5606c061415bac91f2be2d152744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:40.205193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:40.206172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d31d1c91-a0c6-4e5f-b024-f22276049d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:40.209927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1121/2215] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:39 2021] DELETE /identity/v3/projects/7b2c5606c061415bac91f2be2d152744 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:40.215527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7993e-bb0f-4367-ade7-4bc773096f64 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.215821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7993e-bb0f-4367-ade7-4bc773096f64 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.216103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7993e-bb0f-4367-ade7-4bc773096f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.255890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-07a7993e-bb0f-4367-ade7-4bc773096f64 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:40.257142 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-07a7993e-bb0f-4367-ade7-4bc773096f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:40.339662 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1095/2216] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:40.349731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc217f-0d2c-46f8-b565-26ccffbb17fb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.350057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc217f-0d2c-46f8-b565-26ccffbb17fb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.350426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc217f-0d2c-46f8-b565-26ccffbb17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.373042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d5cc217f-0d2c-46f8-b565-26ccffbb17fb None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:40.374540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d5cc217f-0d2c-46f8-b565-26ccffbb17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:40.383845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1122/2217] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:40.388178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7993e-bb0f-4367-ade7-4bc773096f64 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:40.400178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7993e-bb0f-4367-ade7-4bc773096f64 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:40.405497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:40.406347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.406826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.407175 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.408843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:40.409046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:40.410740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:40.427646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1096/2218] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:35:40.428727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc217f-0d2c-46f8-b565-26ccffbb17fb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:40.440571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc217f-0d2c-46f8-b565-26ccffbb17fb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:40.447875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:40.448862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.449313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.449595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.450390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:40.452587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:40.560711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1123/2219] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:40 2021] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:40.568100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:40.591642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3101-d327-4012-97eb-b58f82c9c48c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:40.655676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:40.656340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.656618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.656888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.658233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:40.660188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:40.741153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1097/2220] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:40 2021] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:40.744548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:40.756331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1b40b-9ec5-4bc0-90e6-ba0babc16084 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:40.763930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:40.764625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.765344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.765677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.767060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:40.769701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:40.782025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1124/2221] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:40.786366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:40.797156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57be17-b4c5-4cd5-93d0-086df2d9888c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:40.802817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9d2d2-8bf8-4529-95e3-61ac3e9a7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:40.803501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d2d2-8bf8-4529-95e3-61ac3e9a7d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.803840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d2d2-8bf8-4529-95e3-61ac3e9a7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.804041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d2d2-8bf8-4529-95e3-61ac3e9a7d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.804794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9d2d2-8bf8-4529-95e3-61ac3e9a7d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:40.806437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9d2d2-8bf8-4529-95e3-61ac3e9a7d23 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:40.817067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1098/2222] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:40.827310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:40.838373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042538b-77a7-466a-abe3-456302eb9f85 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:40.843223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:40.844260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.844681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.849669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] PATH_INFO: `/v3/projects/82901dbb85854e63abf8392baa86bda3/users/aff83561f85c48438e73831f934735f6/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.866422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=82901dbb85854e63abf8392baa86bda3, user_id=aff83561f85c48438e73831f934735f6, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:40.869364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:40.942364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1125/2223] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:40 2021] PUT /identity/v3/projects/82901dbb85854e63abf8392baa86bda3/users/aff83561f85c48438e73831f934735f6/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:40.946667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:40.946967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:40.947248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:40.995614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] MFA Rules not processed for user `aff83561f85c48438e73831f934735f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:40.997145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:41.099787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1099/2224] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:40 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:41.113393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:41.116181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:41.173557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153be1a-7a82-4625-8393-c27b821a87ac admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:41.178351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac892cf-278e-437d-85c1-617b24e386fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:41.178695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac892cf-278e-437d-85c1-617b24e386fa service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:41.178984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac892cf-278e-437d-85c1-617b24e386fa service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:41.179266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac892cf-278e-437d-85c1-617b24e386fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:41.192452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac892cf-278e-437d-85c1-617b24e386fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:41.194018 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac892cf-278e-437d-85c1-617b24e386fa service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:41.206360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1126/2225] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:41 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:41.957757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:41.961894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:42.072047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce36ee3-1026-44fe-bcf4-a659f8e0a8e8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:42.076709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:42.078103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:42.078432 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:42.081575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] PATH_INFO: `/v3/users/d4de1167a2df4ac2aadc20318fd13154` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:42.081575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4de1167a2df4ac2aadc20318fd13154)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:42.083940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:42.305318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4de1167a2df4ac2aadc20318fd13154'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:42.306123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4de1167a2df4ac2aadc20318fd13154'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:42.321170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4de1167a2df4ac2aadc20318fd13154'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:42.322629 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4de1167a2df4ac2aadc20318fd13154'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:42.416574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4de1167a2df4ac2aadc20318fd13154'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:42.467922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1100/2226] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:41 2021] DELETE /identity/v3/users/d4de1167a2df4ac2aadc20318fd13154 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:42.472577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:42.473073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:42.473151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:42.497564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:42.498857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:42.671391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1127/2227] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:42.686587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:42.688348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:42.776564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15ab47-52db-4ab9-bb96-a10fd8ef7ceb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:42.783907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:42.784874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:42.785225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:42.785507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:42.800218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:42.803544 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:42.818493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1101/2228] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:43.393384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:43.396641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:43.413552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b5be9-ecaa-480d-a561-29f65d63c64d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:43.420448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:43.421894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:43.421894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:43.422372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] PATH_INFO: `/v3/projects/6bde03cb03864d69ad30ce991e8049b8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:43.423481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bde03cb03864d69ad30ce991e8049b8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:43.431883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:43.629518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bde03cb03864d69ad30ce991e8049b8', 'request_id': 'req-87fa123a-c068-4e01-83ab-692b22cbf6be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:43.638814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bde03cb03864d69ad30ce991e8049b8', 'request_id': 'req-87fa123a-c068-4e01-83ab-692b22cbf6be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:43.763251 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bde03cb03864d69ad30ce991e8049b8', 'request_id': 'req-87fa123a-c068-4e01-83ab-692b22cbf6be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:43.779447 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] The token cache is being invalidate because project 6bde03cb03864d69ad30ce991e8049b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:43.780010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:43.781546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:43.784226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1128/2229] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:43 2021] DELETE /identity/v3/projects/6bde03cb03864d69ad30ce991e8049b8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:43.788031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:43.799868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754136-4783-49c3-ace1-8bb5c7be7ad6 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:43.879115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:43.880151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:43.880621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:43.880969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] PATH_INFO: `/v3/users/8fbb2feaa423412388f9626aaed12875` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:43.882457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fbb2feaa423412388f9626aaed12875)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:43.884493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:44.158120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fbb2feaa423412388f9626aaed12875'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:44.158959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fbb2feaa423412388f9626aaed12875'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:44.174290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fbb2feaa423412388f9626aaed12875'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:44.175018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fbb2feaa423412388f9626aaed12875'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:44.288445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a4876649-61bb-43ae-b137-132fc74ca771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fbb2feaa423412388f9626aaed12875'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:44.308134 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1102/2230] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:43 2021] DELETE /identity/v3/users/8fbb2feaa423412388f9626aaed12875 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:45.208932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:45.211327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:45.228097 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa123a-c068-4e01-83ab-692b22cbf6be admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:45.290051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:45.291043 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:45.291337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:45.291618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] PATH_INFO: `/v3/projects/38eeeae02898421bbc19e201ec29ce5b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:45.292841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=38eeeae02898421bbc19e201ec29ce5b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:45.295145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:45.426514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38eeeae02898421bbc19e201ec29ce5b', 'request_id': 'req-bdf2faf8-1840-4b6d-8104-f380569281fc'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:45.432549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38eeeae02898421bbc19e201ec29ce5b', 'request_id': 'req-bdf2faf8-1840-4b6d-8104-f380569281fc'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:45.528189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38eeeae02898421bbc19e201ec29ce5b', 'request_id': 'req-bdf2faf8-1840-4b6d-8104-f380569281fc'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:45.553220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] The token cache is being invalidate because project 38eeeae02898421bbc19e201ec29ce5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:45.553220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:45.553220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bdf2faf8-1840-4b6d-8104-f380569281fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:45.553220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1129/2231] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:45 2021] DELETE /identity/v3/projects/38eeeae02898421bbc19e201ec29ce5b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:45.555417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16767f1-b3ef-45f2-8083-524ed097dd9d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:45.555842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16767f1-b3ef-45f2-8083-524ed097dd9d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:45.556034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16767f1-b3ef-45f2-8083-524ed097dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:45.577166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b16767f1-b3ef-45f2-8083-524ed097dd9d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:45.578624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b16767f1-b3ef-45f2-8083-524ed097dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:45.708574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1103/2232] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:45.710414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad43e02-ee86-4f3c-b13a-00e84bc3a404 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:45.710768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad43e02-ee86-4f3c-b13a-00e84bc3a404 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:45.711250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad43e02-ee86-4f3c-b13a-00e84bc3a404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:45.739115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9ad43e02-ee86-4f3c-b13a-00e84bc3a404 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:45.740546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9ad43e02-ee86-4f3c-b13a-00e84bc3a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:45.750130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1130/2233] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:45.754508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16767f1-b3ef-45f2-8083-524ed097dd9d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:45.766789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16767f1-b3ef-45f2-8083-524ed097dd9d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:45.772763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcaf3-e70f-41c9-ab94-311fdccc6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:45.773305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcaf3-e70f-41c9-ab94-311fdccc6436 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:45.773650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcaf3-e70f-41c9-ab94-311fdccc6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:45.773864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcaf3-e70f-41c9-ab94-311fdccc6436 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:45.774665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcaf3-e70f-41c9-ab94-311fdccc6436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:45.774963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcaf3-e70f-41c9-ab94-311fdccc6436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:45.777324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcaf3-e70f-41c9-ab94-311fdccc6436 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:45.794605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1104/2234] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:35:45.796170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad43e02-ee86-4f3c-b13a-00e84bc3a404 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:45.812988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad43e02-ee86-4f3c-b13a-00e84bc3a404 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:45.819533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:45.820527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:45.820949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:45.821227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:45.822241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:45.825046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:45.918198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:45.918518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:45.920611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:45.928471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1131/2235] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:45 2021] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:45.934030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:45.959395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] MFA Rules not processed for user `556ba510e962446888479f57eb098555`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:45.963799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:46.024444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2613279-e878-4653-ba3f-1faa7a6cc3d6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.053195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.053784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.054075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.054386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.062710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.062710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.086786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1105/2236] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:45 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:46.088027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.089675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:46.114130 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96a908-3566-4b6f-b83f-54a83b8eb1c1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.121686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.122939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.123295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.123882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.124587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.126754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.168564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1132/2237] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:45 2021] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:46.175907 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.191838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ace55-e00d-43e3-9d74-5bc674301792 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.197124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.197921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.198308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.198814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.199820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.201749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.232400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1133/2238] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:46 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:46.233313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.244770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9be942-d372-4f1c-9321-d256bf60db48 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.249634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.250358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.250631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.251603 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.252372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.254524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.264809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1106/2239] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:46 2021] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:46.269239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.270609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1134/2240] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:46 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:46.275363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.287792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78707-94ab-4194-86ba-23138e27e52d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.344152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370cc72-11ba-4fc5-95b5-4934acedc27f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.350242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.350930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.351213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.351487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.352483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.354519 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.362673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afa3af-1237-4568-ac80-bec55da00230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.363568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afa3af-1237-4568-ac80-bec55da00230 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.363850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afa3af-1237-4568-ac80-bec55da00230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.364212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afa3af-1237-4568-ac80-bec55da00230 admin admin] PATH_INFO: `/v3/projects/a5efa3d981454bc48982bd5084aa700e/users/f64abc3fa9fd44e28db5ca15c3518dc1/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.380713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afa3af-1237-4568-ac80-bec55da00230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5efa3d981454bc48982bd5084aa700e, user_id=f64abc3fa9fd44e28db5ca15c3518dc1, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.385586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afa3af-1237-4568-ac80-bec55da00230 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.440229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1107/2241] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:46 2021] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:35:46.444274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.455354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa48a68-30e1-406b-a248-2b2f18f5d166 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.461723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.462528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.462875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.465010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.465010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.465466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1135/2242] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:46 2021] PUT /identity/v3/projects/a5efa3d981454bc48982bd5084aa700e/users/f64abc3fa9fd44e28db5ca15c3518dc1/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:46.465767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.486662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.486662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.486662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.487039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1108/2243] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:46 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:46.487810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.498280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dada0-518d-4a56-aea6-550ed27958ea admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.511269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] MFA Rules not processed for user `f64abc3fa9fd44e28db5ca15c3518dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:46.512508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:46.642935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1136/2244] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:46 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:46.648631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.651787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.652149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.652534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] PATH_INFO: `/v3/projects/ff83b8f40e504e65b721118e313433b4/users/58990c542d1644599b1e2a19226903b8/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.653795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.655474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:46.674245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff83b8f40e504e65b721118e313433b4, user_id=58990c542d1644599b1e2a19226903b8, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.677732 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.794880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1109/2245] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:46 2021] PUT /identity/v3/projects/ff83b8f40e504e65b721118e313433b4/users/58990c542d1644599b1e2a19226903b8/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:46.799218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.813453 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a5f6-4f5f-4e7c-950c-bfa5b5deadc1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.871170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf2bf9-d4f8-4609-833c-98676a8def15 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.875848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.877053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.877794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.877794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.878362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.879976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.881972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a97df6-b8f1-4620-8758-1d6ccc488829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.882765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a97df6-b8f1-4620-8758-1d6ccc488829 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.883154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a97df6-b8f1-4620-8758-1d6ccc488829 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.883533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a97df6-b8f1-4620-8758-1d6ccc488829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.889984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1110/2246] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:46 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:46.894701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:46.908522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aa417-51e0-4973-aa34-29be6c0daa94 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:46.916730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c81cc-2fc0-4a98-b878-41c3dd571cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:46.917614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c81cc-2fc0-4a98-b878-41c3dd571cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:46.917899 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c81cc-2fc0-4a98-b878-41c3dd571cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:46.918169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c81cc-2fc0-4a98-b878-41c3dd571cdb admin admin] PATH_INFO: `/v3/projects/ff83b8f40e504e65b721118e313433b4/users/58990c542d1644599b1e2a19226903b8/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:46.920210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c81cc-2fc0-4a98-b878-41c3dd571cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff83b8f40e504e65b721118e313433b4, user_id=58990c542d1644599b1e2a19226903b8, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.922886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c81cc-2fc0-4a98-b878-41c3dd571cdb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.934281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1111/2247] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:35:46 2021] PUT /identity/v3/projects/ff83b8f40e504e65b721118e313433b4/users/58990c542d1644599b1e2a19226903b8/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:35:46.953434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a97df6-b8f1-4620-8758-1d6ccc488829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:46.955853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a97df6-b8f1-4620-8758-1d6ccc488829 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:46.965846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1137/2248] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:46 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:35:48.449510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:48.450391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:48.450822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:48.498297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] MFA Rules not processed for user `73c964b90fee4542ba1b742b4a0caa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:48.499723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:48.615851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1112/2249] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:48 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:54.169614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f7ae-9d7c-4b40-9035-1ddcab1187e0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:54.174126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f7ae-9d7c-4b40-9035-1ddcab1187e0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:54.174126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f7ae-9d7c-4b40-9035-1ddcab1187e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:54.203059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fc91f7ae-9d7c-4b40-9035-1ddcab1187e0 None None] MFA Rules not processed for user `58990c542d1644599b1e2a19226903b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:54.204853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fc91f7ae-9d7c-4b40-9035-1ddcab1187e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:54.273786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1138/2250] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:54 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:54.285809 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:54.287263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:54.400499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f2856-816b-4ec9-8310-0a8469e63a7c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:54.417718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f5ff1-5423-47a2-a107-466769db11c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:54.417718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f5ff1-5423-47a2-a107-466769db11c6 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:54.417718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f5ff1-5423-47a2-a107-466769db11c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:54.417718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f5ff1-5423-47a2-a107-466769db11c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:54.483242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f5ff1-5423-47a2-a107-466769db11c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:54.485092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f5ff1-5423-47a2-a107-466769db11c6 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:54.496924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1113/2251] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:54 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:58.003454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f7ae-9d7c-4b40-9035-1ddcab1187e0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:58.082973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f7ae-9d7c-4b40-9035-1ddcab1187e0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:58.097176 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:58.098600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:58.098885 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:58.099413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] PATH_INFO: `/v3/users/f64abc3fa9fd44e28db5ca15c3518dc1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:58.100750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64abc3fa9fd44e28db5ca15c3518dc1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:58.103333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:58.216195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230227f-e5c0-492a-9d24-f780172acbd8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:58.216711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230227f-e5c0-492a-9d24-f780172acbd8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:58.216791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230227f-e5c0-492a-9d24-f780172acbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:58.234397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a230227f-e5c0-492a-9d24-f780172acbd8 None None] MFA Rules not processed for user `556ba510e962446888479f57eb098555`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:58.241143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a230227f-e5c0-492a-9d24-f780172acbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:58.243399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1114/2252] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:58.300202 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64abc3fa9fd44e28db5ca15c3518dc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:58.312683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64abc3fa9fd44e28db5ca15c3518dc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:58.313508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64abc3fa9fd44e28db5ca15c3518dc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:58.315177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64abc3fa9fd44e28db5ca15c3518dc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:58.323288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64abc3fa9fd44e28db5ca15c3518dc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:58.391007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1139/2253] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:35:58 2021] DELETE /identity/v3/users/f64abc3fa9fd44e28db5ca15c3518dc1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:58.397299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:58.397686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:58.398036 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:58.417220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:58.418230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:58.486381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1115/2254] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:58.500095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:58.502471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:58.579614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344d071-b700-49a0-8fa5-d2fe94632ccd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:58.588128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364835df-d1ab-46bf-950b-984c13729984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:58.588792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364835df-d1ab-46bf-950b-984c13729984 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:58.589080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364835df-d1ab-46bf-950b-984c13729984 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:58.589363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364835df-d1ab-46bf-950b-984c13729984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:58.605623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364835df-d1ab-46bf-950b-984c13729984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:58.607145 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364835df-d1ab-46bf-950b-984c13729984 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:58.619123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1140/2255] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:35:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:35:59.107236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:59.109256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:59.123578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4b33-f578-44e9-a494-85fc8cab25aa None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:59.132094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:59.132094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:59.132094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:59.135578 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] PATH_INFO: `/v3/projects/a5efa3d981454bc48982bd5084aa700e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:59.141646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5efa3d981454bc48982bd5084aa700e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:59.144384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:59.291641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5efa3d981454bc48982bd5084aa700e', 'request_id': 'req-f8a9fec8-82e1-4a44-8281-0d04b1578741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:59.298791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5efa3d981454bc48982bd5084aa700e', 'request_id': 'req-f8a9fec8-82e1-4a44-8281-0d04b1578741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:59.385379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5efa3d981454bc48982bd5084aa700e', 'request_id': 'req-f8a9fec8-82e1-4a44-8281-0d04b1578741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:59.399835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] The token cache is being invalidate because project a5efa3d981454bc48982bd5084aa700e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:35:59.400337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:59.401212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a9fec8-82e1-4a44-8281-0d04b1578741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:35:59.402875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1116/2256] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:35:59 2021] DELETE /identity/v3/projects/a5efa3d981454bc48982bd5084aa700e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:35:59.409853 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0eae-0587-40c1-97e6-c363e77a0a71 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:59.410489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0eae-0587-40c1-97e6-c363e77a0a71 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:59.410583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a0eae-0587-40c1-97e6-c363e77a0a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:59.430422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a84a0eae-0587-40c1-97e6-c363e77a0a71 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:59.431657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a84a0eae-0587-40c1-97e6-c363e77a0a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:59.507846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1141/2257] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:35:59.517552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8646362-944b-4a84-830c-e43b4481888e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:59.518107 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8646362-944b-4a84-830c-e43b4481888e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:59.518425 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8646362-944b-4a84-830c-e43b4481888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:59.538795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a8646362-944b-4a84-830c-e43b4481888e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:35:59.540070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a8646362-944b-4a84-830c-e43b4481888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:35:59.548875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1117/2258] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:35:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:35:59.553820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a0eae-0587-40c1-97e6-c363e77a0a71 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:59.565057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a0eae-0587-40c1-97e6-c363e77a0a71 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:59.570122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:59.570824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:59.571111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:59.571410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:59.572226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:35:59.572536 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:59.574125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:59.586817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1142/2259] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:35:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:35:59.591163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8646362-944b-4a84-830c-e43b4481888e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:59.601091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8646362-944b-4a84-830c-e43b4481888e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:59.606097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:59.606848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:59.607187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:59.607651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:59.608812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:59.611437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:59.725239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1118/2260] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:35:59 2021] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:59.729350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:59.740790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a873fc-a2a1-4164-bc1b-dc1d978790f0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:59.804531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:59.805434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:59.805930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:59.806278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:59.807046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:59.809079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:59.948931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1143/2261] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:35:59 2021] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:35:59.950719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:35:59.962395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c629a-3c5b-4736-8880-74e7ef358994 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:35:59.967607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:35:59.968324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:35:59.968614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:35:59.968903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:35:59.969730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:35:59.972000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:35:59.982788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1119/2262] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:59 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:35:59.990147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:00.000178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613577b0-096d-4918-84a9-eab7afece905 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:00.005193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac0547-0baf-4661-b19f-29ca6ee816ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:00.005852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac0547-0baf-4661-b19f-29ca6ee816ad admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:00.006139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac0547-0baf-4661-b19f-29ca6ee816ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:00.006490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac0547-0baf-4661-b19f-29ca6ee816ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:00.007198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac0547-0baf-4661-b19f-29ca6ee816ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:00.008791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac0547-0baf-4661-b19f-29ca6ee816ad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:00.023620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1144/2263] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:35:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:36:00.024814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:00.043051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7919c5-0ed9-405e-b826-2f99ebbc3ed6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:00.047858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:00.049319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:00.056295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:00.056295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] PATH_INFO: `/v3/projects/e569c14b005a4bb1955a9b5611f9b791/users/005b3a6329414ac49cbf8c2ac53dbe91/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:00.067795 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e569c14b005a4bb1955a9b5611f9b791, user_id=005b3a6329414ac49cbf8c2ac53dbe91, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:00.070665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:00.155581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1120/2264] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:36:00 2021] PUT /identity/v3/projects/e569c14b005a4bb1955a9b5611f9b791/users/005b3a6329414ac49cbf8c2ac53dbe91/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:00.166439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1494e-9e5f-4ea9-81e5-e9c88141a67c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:00.166880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1494e-9e5f-4ea9-81e5-e9c88141a67c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:00.167420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1494e-9e5f-4ea9-81e5-e9c88141a67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:00.200866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-16e1494e-9e5f-4ea9-81e5-e9c88141a67c None None] MFA Rules not processed for user `005b3a6329414ac49cbf8c2ac53dbe91`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:00.202109 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-16e1494e-9e5f-4ea9-81e5-e9c88141a67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:00.268330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1145/2265] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:00 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:00.278969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:00.280625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:00.337438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8129-2a71-4de3-8192-d045147c0d77 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:00.341041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2488f7-9e61-4798-9f96-780f2c5d4fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:00.341685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2488f7-9e61-4798-9f96-780f2c5d4fcc service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:00.341973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2488f7-9e61-4798-9f96-780f2c5d4fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:00.342281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2488f7-9e61-4798-9f96-780f2c5d4fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:00.351071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2488f7-9e61-4798-9f96-780f2c5d4fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:00.352502 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2488f7-9e61-4798-9f96-780f2c5d4fcc service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:00.361151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1121/2266] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:36:00 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:36:03.421164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:03.422152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:03.422612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:03.442010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] MFA Rules not processed for user `01987e7fb04b44bcbe2c57f635fb5e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:03.446426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:03.499501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1146/2267] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:03 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:36.402022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:36.402552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:36.402712 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:36.461290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:36.462537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:36.532275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1122/2268] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:36:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:36.577867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:36.579317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:36.668622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb4b12-b76c-451f-a7b0-ee3ac0c9ec45 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:36.673571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:36.674235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:36.674520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:36.674820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:36.683427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:36.684986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:36.693240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1147/2269] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:36:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:36:40.775522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:40.777004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:40.889750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782e290-3f0c-4a81-99a2-fe448a3509ed None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:40.896339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a0c26778994b0c93541400cde47bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:40.897045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:40.897237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:40.897517 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:40.899348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:40.913289 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:40.915102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:40.927603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1123/2270] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:36:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:36:41.920314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:42.023884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962832-2210-4178-acc9-af75e3266c97 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:42.030218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:42.031247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:42.031607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:42.032805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] PATH_INFO: `/v3/users/005b3a6329414ac49cbf8c2ac53dbe91` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:42.034164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005b3a6329414ac49cbf8c2ac53dbe91)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:42.037038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:42.261176 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005b3a6329414ac49cbf8c2ac53dbe91'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.278817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005b3a6329414ac49cbf8c2ac53dbe91'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.279794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005b3a6329414ac49cbf8c2ac53dbe91'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.280616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005b3a6329414ac49cbf8c2ac53dbe91'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.292178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:42.294043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:42.306830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-000682c2-955f-469c-8e09-e1b22a6ef506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005b3a6329414ac49cbf8c2ac53dbe91'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.328688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b47685-5a4c-4d92-8969-707c0271ebc2 service placement] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:42.334512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:42.342071 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:42.344524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:42.345987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] PATH_INFO: `/v3/users/aff83561f85c48438e73831f934735f6` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:42.351011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff83561f85c48438e73831f934735f6)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:42.365490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:42.474946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1148/2271] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:36:41 2021] DELETE /identity/v3/users/005b3a6329414ac49cbf8c2ac53dbe91 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:42.479586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:42.479881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:42.480164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:42.503493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:42.505888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:42.600784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1149/2272] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:36:42.611934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:42.613521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:42.640901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff83561f85c48438e73831f934735f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.642452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff83561f85c48438e73831f934735f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.667305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff83561f85c48438e73831f934735f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.668652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff83561f85c48438e73831f934735f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.697892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414b1b9-2c36-4575-9f77-cc866430ac5d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:42.702040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4309c5-e00f-41b5-9f8d-f4c3887b7f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:42.702832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4309c5-e00f-41b5-9f8d-f4c3887b7f19 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:42.703238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4309c5-e00f-41b5-9f8d-f4c3887b7f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:42.703643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4309c5-e00f-41b5-9f8d-f4c3887b7f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:42.705676 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-eb4309c5-e00f-41b5-9f8d-f4c3887b7f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:42.722339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4309c5-e00f-41b5-9f8d-f4c3887b7f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:42.724391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4309c5-e00f-41b5-9f8d-f4c3887b7f19 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:42.733923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff83561f85c48438e73831f934735f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:42.740443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1150/2273] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:36:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:36:42.755168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1124/2274] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:36:42 2021] DELETE /identity/v3/users/aff83561f85c48438e73831f934735f6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:42.757935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:42.758336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:42.758691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:42.784528 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:42.785764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:42.881683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1151/2275] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:42.890568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:42.892312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:42.967048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea5900-ab72-4f07-b43e-c27ea83d9a9e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:42.975336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd8327-b509-4c5a-8932-7dfef5c7dd53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:42.976047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd8327-b509-4c5a-8932-7dfef5c7dd53 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:42.976333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd8327-b509-4c5a-8932-7dfef5c7dd53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:42.977351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd8327-b509-4c5a-8932-7dfef5c7dd53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:42.988084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd8327-b509-4c5a-8932-7dfef5c7dd53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:42.990277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd8327-b509-4c5a-8932-7dfef5c7dd53 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:43.001711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1125/2276] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:36:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:36:43.398913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:43.400455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:43.424613 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ce7a8-6b49-4b81-86a5-85c2b063a2da None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:43.437855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:43.450871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:43.453305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:43.453951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] PATH_INFO: `/v3/projects/e569c14b005a4bb1955a9b5611f9b791` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:43.458643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e569c14b005a4bb1955a9b5611f9b791)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:43.460591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:43.647416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e569c14b005a4bb1955a9b5611f9b791', 'request_id': 'req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:43.657467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e569c14b005a4bb1955a9b5611f9b791', 'request_id': 'req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:43.736384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e569c14b005a4bb1955a9b5611f9b791', 'request_id': 'req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:43.749747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] The token cache is being invalidate because project e569c14b005a4bb1955a9b5611f9b791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:36:43.750085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:43.751345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15442f39-3cfc-4ca3-8d75-a1ad9e00c0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:43.753643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1152/2277] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:36:43 2021] DELETE /identity/v3/projects/e569c14b005a4bb1955a9b5611f9b791 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:43.761777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1335bf-43c3-4f37-bfde-41639ad06db7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:43.762340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1335bf-43c3-4f37-bfde-41639ad06db7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:43.762431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1335bf-43c3-4f37-bfde-41639ad06db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:43.784916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1d1335bf-43c3-4f37-bfde-41639ad06db7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:43.787084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1d1335bf-43c3-4f37-bfde-41639ad06db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:43.922159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1126/2278] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:43.931577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:43.931917 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:43.932152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:43.969247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:43.970718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:43.982212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1153/2279] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:43.987009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1335bf-43c3-4f37-bfde-41639ad06db7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.000263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1335bf-43c3-4f37-bfde-41639ad06db7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.002334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.006914 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:44.026155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.029890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.029890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.029890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.030316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:36:44.030694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.037490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.045386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1d57c-9ead-4794-bccc-60d10c5b38ef None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.063956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.064912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.065304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.065596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] PATH_INFO: `/v3/projects/82901dbb85854e63abf8392baa86bda3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.067498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1127/2280] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:36:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:36:44.069173 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82901dbb85854e63abf8392baa86bda3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.071489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.071684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.084610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309fdd1-24f5-463b-9ead-69f080fdea2a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.091623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.092356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.092672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.092961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.093741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.095820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.175698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1128/2281] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:36:44 2021] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:36:44.179817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.225848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82901dbb85854e63abf8392baa86bda3', 'request_id': 'req-8363e368-e496-4c8b-b580-98a312a1b3e8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:44.233957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82901dbb85854e63abf8392baa86bda3', 'request_id': 'req-8363e368-e496-4c8b-b580-98a312a1b3e8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:44.275658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd5f4-75d6-48d3-be91-997618bd4b87 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.311049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82901dbb85854e63abf8392baa86bda3', 'request_id': 'req-8363e368-e496-4c8b-b580-98a312a1b3e8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:44.339983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] The token cache is being invalidate because project 82901dbb85854e63abf8392baa86bda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:36:44.345926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:44.351630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8363e368-e496-4c8b-b580-98a312a1b3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:36:44.356664 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1154/2282] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:36:44 2021] DELETE /identity/v3/projects/82901dbb85854e63abf8392baa86bda3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:44.369721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db0f6-3ba4-41e0-b868-9b9a60e1ba09 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.370043 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db0f6-3ba4-41e0-b868-9b9a60e1ba09 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.370354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db0f6-3ba4-41e0-b868-9b9a60e1ba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.410030 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.411152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.411642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.412119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.413052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.415301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.422223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e11db0f6-3ba4-41e0-b868-9b9a60e1ba09 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:44.427479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e11db0f6-3ba4-41e0-b868-9b9a60e1ba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:44.440640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1155/2283] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:44.448622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e380-b899-443d-b2f3-5f2c6a3f04b9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.448932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e380-b899-443d-b2f3-5f2c6a3f04b9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.449220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e380-b899-443d-b2f3-5f2c6a3f04b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.477566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5ba7e380-b899-443d-b2f3-5f2c6a3f04b9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:44.479166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5ba7e380-b899-443d-b2f3-5f2c6a3f04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:44.495915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1156/2284] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:36:44.504683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1129/2285] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:36:44 2021] POST /identity/v3/users => generated 290 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:36:44.508643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e380-b899-443d-b2f3-5f2c6a3f04b9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.511866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.513767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:44.531234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e380-b899-443d-b2f3-5f2c6a3f04b9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.535707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b48767-1d72-49de-9701-b21ba41d4511 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.547030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.547868 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.548381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.549293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.550883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:36:44.551710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.552800 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.555757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.556400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.556791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.557132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.562059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.564094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.588540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1130/2287] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:36:44.588805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1157/2287] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:36:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:36:44.589754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.599356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.610792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0ee3e-b55a-4472-8e49-c283397708bb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.613753 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad898e-ccdd-455b-bf35-241712204001 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.617785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.618770 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.619322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.620051 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.621096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.623828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.632405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.633193 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.633550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.633898 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.634760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.636467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.650419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1131/2288] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:36:44.663666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.678238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9bd77-1ebf-4a59-a1cb-1a5419215410 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:44.686967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f89100-f94f-4079-b950-b527fa34711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:44.688039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89100-f94f-4079-b950-b527fa34711f admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.688359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89100-f94f-4079-b950-b527fa34711f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.688751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89100-f94f-4079-b950-b527fa34711f admin admin] PATH_INFO: `/v3/projects/e8b27862260c4e10a2a4649abac781fd/users/9cec710bddca4e6c890c99580d172053/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.720722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f89100-f94f-4079-b950-b527fa34711f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b27862260c4e10a2a4649abac781fd, user_id=9cec710bddca4e6c890c99580d172053, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:44.724499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f89100-f94f-4079-b950-b527fa34711f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:44.750702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1158/2289] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:36:44 2021] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:36:44.751941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:44.812089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1132/2290] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:36:44 2021] PUT /identity/v3/projects/e8b27862260c4e10a2a4649abac781fd/users/9cec710bddca4e6c890c99580d172053/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:44.816884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:44.817413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:44.817863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:44.851651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:44.866282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:44.945700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68270467-b381-4758-92a9-054dd6e5d5ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:45.029620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1133/2291] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:45.039717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:45.041146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:45.176081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:45.176722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:45.177007 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:45.177285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:45.178117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:45.197577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:45.214202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3895f8c-f75b-48c1-8389-2954ca9c63c6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:45.220077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:45.220938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:45.221337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:45.222796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:45.278126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:45.281384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:45.318135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1134/2292] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:36:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:36:45.343489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1159/2293] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:36:44 2021] POST /identity/v3/users => generated 285 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:36:45.348848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:45.365655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7c40-e9ac-48c8-a29c-57e578feb4db service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:45.374676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:45.375560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:45.375959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:45.376360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:45.377213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:45.379035 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:45.391743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1135/2294] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:36:45 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:36:45.399632 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:45.414274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7876-7673-4f6c-bd73-116a7522cc54 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:45.423711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaec219-890a-411c-9eb2-5366971a606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:45.424670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec219-890a-411c-9eb2-5366971a606d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:45.424957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec219-890a-411c-9eb2-5366971a606d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:45.425238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec219-890a-411c-9eb2-5366971a606d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:45.425996 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaec219-890a-411c-9eb2-5366971a606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:45.428474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaec219-890a-411c-9eb2-5366971a606d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:45.442229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1160/2295] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:36:45 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:36:45.445757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:45.463256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11adef-227c-43b8-a4ce-d1464e1115f4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:45.472870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:45.474442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:45.475245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:45.475860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] PATH_INFO: `/v3/projects/9f44bb70e4034cf4895efc1d9c1ac6b7/users/01cff8b374c842d6a8be137e0bdd0394/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:45.495939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f44bb70e4034cf4895efc1d9c1ac6b7, user_id=01cff8b374c842d6a8be137e0bdd0394, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:45.498996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:45.597565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1136/2296] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:36:45 2021] PUT /identity/v3/projects/9f44bb70e4034cf4895efc1d9c1ac6b7/users/01cff8b374c842d6a8be137e0bdd0394/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:45.608680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb259f49-94b3-468f-8dfc-aee3968df93b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:45.609137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb259f49-94b3-468f-8dfc-aee3968df93b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:45.609517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb259f49-94b3-468f-8dfc-aee3968df93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:45.643110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-eb259f49-94b3-468f-8dfc-aee3968df93b None None] MFA Rules not processed for user `01cff8b374c842d6a8be137e0bdd0394`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:45.644652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-eb259f49-94b3-468f-8dfc-aee3968df93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:45.750231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1161/2297] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:45 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:45.763930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:45.771886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:45.917720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d544cd-4dae-4fa9-807c-67268dd4427a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:45.922800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:45.922800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:45.923052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:45.923261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:45.938645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:45.940485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:45.967018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1137/2298] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:36:45 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:36:53.474475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8a04-33ec-43e6-8253-3c607e420074 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:53.476552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8a04-33ec-43e6-8253-3c607e420074 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:53.477061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e8a04-33ec-43e6-8253-3c607e420074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:53.518953 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2e4e8a04-33ec-43e6-8253-3c607e420074 None None] MFA Rules not processed for user `9cec710bddca4e6c890c99580d172053`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:36:53.521175 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2e4e8a04-33ec-43e6-8253-3c607e420074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:36:53.626965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1162/2299] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:36:53 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:36:53.632561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:53.729445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ec8c4-f987-4928-8d3c-6ab35a5057e1 service glance] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:53.733970 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:53.734680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:53.734965 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:53.735244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:53.736041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:53.737977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:53.822674 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1138/2300] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:36:53 2021] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:36:53.825756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8a04-33ec-43e6-8253-3c607e420074 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:53.845651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e8a04-33ec-43e6-8253-3c607e420074 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:53.916247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:53.916939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:53.917225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:53.917503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:53.918250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:53.920167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:54.011378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1163/2301] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:36:53 2021] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:36:54.017825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:54.029497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d65f5-ed22-4465-af6d-be3d887490c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:54.034774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:54.035491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:54.036878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:54.037624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:54.038437 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:54.040155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:54.050980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1139/2302] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:36:54 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:36:54.055378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:54.065426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69bcf2-d3b7-48f6-9f07-2950b9087215 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:54.071668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:54.072564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:54.072872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:54.073199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] PATH_INFO: `/v3/projects/a70d9ab6136f475f8bc6ea3fba6fb28e/users/798c1d683bc84498a098c45fc9ad2667/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:54.090156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70d9ab6136f475f8bc6ea3fba6fb28e, user_id=798c1d683bc84498a098c45fc9ad2667, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:54.094571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:54.164735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1164/2303] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:36:54 2021] PUT /identity/v3/projects/a70d9ab6136f475f8bc6ea3fba6fb28e/users/798c1d683bc84498a098c45fc9ad2667/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:36:54.168929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:54.184784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5624-5ff2-43d0-815d-bbce0b4b9591 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:54.340029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcf193-8481-4465-88d1-a74187d443a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:54.340731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcf193-8481-4465-88d1-a74187d443a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:54.341040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcf193-8481-4465-88d1-a74187d443a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:54.341374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcf193-8481-4465-88d1-a74187d443a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:54.342072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcf193-8481-4465-88d1-a74187d443a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:54.343718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcf193-8481-4465-88d1-a74187d443a4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:54.359220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1140/2304] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:36:54 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:36:54.360052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:36:54.375102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a16cdc-363f-4ddb-9bc2-c595d7b4bede admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:36:54.382760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:36:54.384339 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:36:54.384825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:36:54.385370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] PATH_INFO: `/v3/projects/a70d9ab6136f475f8bc6ea3fba6fb28e/users/798c1d683bc84498a098c45fc9ad2667/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:36:54.387857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70d9ab6136f475f8bc6ea3fba6fb28e, user_id=798c1d683bc84498a098c45fc9ad2667, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:36:54.391076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:36:54.410717 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1165/2305] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:36:54 2021] PUT /identity/v3/projects/a70d9ab6136f475f8bc6ea3fba6fb28e/users/798c1d683bc84498a098c45fc9ad2667/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:04.289819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:04.290376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:04.290609 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:04.347461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] MFA Rules not processed for user `798c1d683bc84498a098c45fc9ad2667`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:04.351780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:04.491898 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1141/2306] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:04 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:04.505465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:04.508994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:04.645827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f52dc-aed9-4ac7-a2d1-0538bf06d216 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:04.653937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430d93e-90ef-42b0-af54-452b05ec8626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:04.655318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430d93e-90ef-42b0-af54-452b05ec8626 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:04.656143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430d93e-90ef-42b0-af54-452b05ec8626 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:04.656508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430d93e-90ef-42b0-af54-452b05ec8626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:04.866294 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430d93e-90ef-42b0-af54-452b05ec8626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:04.868060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430d93e-90ef-42b0-af54-452b05ec8626 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:04.894030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1166/2307] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:04 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:37:06.663569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:06.665770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:06.765688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01454b2-741d-4282-ac67-b375fbbacf91 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:06.773830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:06.774947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:06.775468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:06.776082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:06.779379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:06.946820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:06.948871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:07.000420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1142/2308] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:06 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:08.628947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:08.629452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:08.629535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:08.653279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:08.654759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:08.731462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1167/2309] 10.222.0.11 () {58 vars in 967 bytes} [Thu Nov 11 16:37:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:08.748186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:08.755203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:08.878127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e314-60e1-4d86-ba92-74df2aa101eb service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:08.884743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:08.885748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:08.886317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:08.886955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:08.897804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:08.899710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:08.912284 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1143/2310] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:37:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:37:12.286157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:12.287667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:12.357928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bae6ef-099b-4541-80b6-1fad88b01310 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:12.362524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:12.363392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:12.363671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:12.363943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] PATH_INFO: `/v3/users/73c964b90fee4542ba1b742b4a0caa2a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:12.365705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c964b90fee4542ba1b742b4a0caa2a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:12.367730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:12.514188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c964b90fee4542ba1b742b4a0caa2a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:12.528146 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c964b90fee4542ba1b742b4a0caa2a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:12.528872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c964b90fee4542ba1b742b4a0caa2a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:12.529565 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c964b90fee4542ba1b742b4a0caa2a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:12.537318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a8cddeb-10e8-4635-a921-6abcd5a294f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c964b90fee4542ba1b742b4a0caa2a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:12.603899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1168/2311] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:12 2021] DELETE /identity/v3/users/73c964b90fee4542ba1b742b4a0caa2a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:12.961295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:12.977524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585701e-45bc-4f04-a4ef-7c47f21a11fb service swift] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:13.034095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:13.035024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.035311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.035591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] PATH_INFO: `/v3/projects/3edf464ea72044b0a65dd300031d24b4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.036843 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edf464ea72044b0a65dd300031d24b4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:13.038785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:13.155794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edf464ea72044b0a65dd300031d24b4', 'request_id': 'req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:13.160925 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edf464ea72044b0a65dd300031d24b4', 'request_id': 'req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:13.207683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edf464ea72044b0a65dd300031d24b4', 'request_id': 'req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:13.220781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] The token cache is being invalidate because project 3edf464ea72044b0a65dd300031d24b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:13.221073 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:13.221717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1546bdf4-3ae1-4347-9107-bee62ba9c1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:13.223292 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1144/2312] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:12 2021] DELETE /identity/v3/projects/3edf464ea72044b0a65dd300031d24b4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:13.229805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd6a9-db10-4206-aa2c-aeea4b4142ce None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.230098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd6a9-db10-4206-aa2c-aeea4b4142ce None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.230471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd6a9-db10-4206-aa2c-aeea4b4142ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.250276 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7a4dd6a9-db10-4206-aa2c-aeea4b4142ce None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:13.251484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7a4dd6a9-db10-4206-aa2c-aeea4b4142ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:13.310005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1169/2313] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:13.318024 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bb1bb-d89a-40f1-9556-c2be9a784b3b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.318412 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bb1bb-d89a-40f1-9556-c2be9a784b3b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.318691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bb1bb-d89a-40f1-9556-c2be9a784b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.337769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-027bb1bb-d89a-40f1-9556-c2be9a784b3b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:13.339015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-027bb1bb-d89a-40f1-9556-c2be9a784b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:13.347088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1145/2314] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:13.351842 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dd6a9-db10-4206-aa2c-aeea4b4142ce None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:13.361558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dd6a9-db10-4206-aa2c-aeea4b4142ce None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:13.367024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:13.367675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.367988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.368273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.369017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:37:13.369328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:13.370992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:13.386520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1170/2315] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:37:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:37:13.387902 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bb1bb-d89a-40f1-9556-c2be9a784b3b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:13.398853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bb1bb-d89a-40f1-9556-c2be9a784b3b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:13.404095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:13.404759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.405039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.405311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.406016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:13.407948 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:13.497659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1146/2316] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:13 2021] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:13.501694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:13.511876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107bcd7-3cd5-4e4e-920f-48b34de80a9b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:13.568158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:13.568818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.569100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.569395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.570090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:13.572012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:13.676037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1171/2317] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:13 2021] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:13.678585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:13.688416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09456f-0fa9-41e8-b943-1385ec2c8808 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:13.700356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:13.702213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.702871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.702871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.703541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:13.705183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:13.720088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1147/2318] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:13 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:13.721286 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:13.732107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2493719-985d-43e4-b7a4-626877ec5aaf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:13.736776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f8c74-48c8-4f06-914c-94c3efc9b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:13.737437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8c74-48c8-4f06-914c-94c3efc9b979 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.737718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8c74-48c8-4f06-914c-94c3efc9b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.737989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f8c74-48c8-4f06-914c-94c3efc9b979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.738768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f8c74-48c8-4f06-914c-94c3efc9b979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:13.740494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f8c74-48c8-4f06-914c-94c3efc9b979 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:13.750900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1172/2319] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:13.756381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:13.766326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db73fa-ee59-445b-884e-83b53e35f592 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:13.772632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:13.773512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.773799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.774225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] PATH_INFO: `/v3/projects/bd02894e57eb4965bf27a76a98ba95ec/users/1c7ef1787aeb4430b9a11d41319b8ad3/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.797441 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd02894e57eb4965bf27a76a98ba95ec, user_id=1c7ef1787aeb4430b9a11d41319b8ad3, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:13.800297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:13.941586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1148/2320] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:13 2021] PUT /identity/v3/projects/bd02894e57eb4965bf27a76a98ba95ec/users/1c7ef1787aeb4430b9a11d41319b8ad3/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:13.952985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:13.953420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:13.953707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:13.983715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] MFA Rules not processed for user `1c7ef1787aeb4430b9a11d41319b8ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:13.984957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:14.053600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1173/2321] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:13 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:37:14.064992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:14.071768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:14.133884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f1719-da0d-4ccf-9fba-0290781375b8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:14.137747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:14.138422 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:14.138713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:14.138989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:14.147834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:14.149279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:14.158083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1149/2322] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:14 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:18.765758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:18.767587 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:18.845986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c39766-8bfd-4dc9-b966-9400450c4977 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:18.852031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:18.853143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:18.853430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:18.853739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] PATH_INFO: `/v3/users/01987e7fb04b44bcbe2c57f635fb5e4e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:18.855021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=01987e7fb04b44bcbe2c57f635fb5e4e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:18.857084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:19.021489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01987e7fb04b44bcbe2c57f635fb5e4e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.033292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01987e7fb04b44bcbe2c57f635fb5e4e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.033991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01987e7fb04b44bcbe2c57f635fb5e4e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.038307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01987e7fb04b44bcbe2c57f635fb5e4e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.042559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3b79f4d0-2243-4b5f-9d78-7eba02f483ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01987e7fb04b44bcbe2c57f635fb5e4e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.116195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1174/2323] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:18 2021] DELETE /identity/v3/users/01987e7fb04b44bcbe2c57f635fb5e4e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:19.353792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:19.381733 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d548ff-45a2-416b-9820-2caf9d36b752 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:19.456480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:19.457345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:19.457630 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:19.457935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] PATH_INFO: `/v3/projects/995594f22a2641a5a6056b04bdcf60c9` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:19.459953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995594f22a2641a5a6056b04bdcf60c9)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:19.462011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:19.574015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995594f22a2641a5a6056b04bdcf60c9', 'request_id': 'req-05641ed7-4755-4bfc-92fc-7032082b4d85'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.582385 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995594f22a2641a5a6056b04bdcf60c9', 'request_id': 'req-05641ed7-4755-4bfc-92fc-7032082b4d85'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.646325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995594f22a2641a5a6056b04bdcf60c9', 'request_id': 'req-05641ed7-4755-4bfc-92fc-7032082b4d85'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.659218 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] The token cache is being invalidate because project 995594f22a2641a5a6056b04bdcf60c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:19.659767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.660438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-05641ed7-4755-4bfc-92fc-7032082b4d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:19.662312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1150/2324] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:19 2021] DELETE /identity/v3/projects/995594f22a2641a5a6056b04bdcf60c9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:19.668327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150eaa-f552-4682-bc83-39c3df1466df None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:19.668629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150eaa-f552-4682-bc83-39c3df1466df None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:19.668884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150eaa-f552-4682-bc83-39c3df1466df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:19.688678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-53150eaa-f552-4682-bc83-39c3df1466df None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:19.689885 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-53150eaa-f552-4682-bc83-39c3df1466df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:19.774016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1175/2325] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:19.781961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638e445-01dc-49fb-8d0e-1142fc530b16 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:19.782452 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638e445-01dc-49fb-8d0e-1142fc530b16 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:19.782698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638e445-01dc-49fb-8d0e-1142fc530b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:19.808127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8638e445-01dc-49fb-8d0e-1142fc530b16 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:19.810980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8638e445-01dc-49fb-8d0e-1142fc530b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:19.823960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1151/2326] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:19.828195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150eaa-f552-4682-bc83-39c3df1466df None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:19.840606 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150eaa-f552-4682-bc83-39c3df1466df None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:19.847557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:19.850327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:19.850327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:19.850327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:19.850327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:37:19.850327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:19.851465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:19.863511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1176/2327] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:37:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:37:19.867857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638e445-01dc-49fb-8d0e-1142fc530b16 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:19.876955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638e445-01dc-49fb-8d0e-1142fc530b16 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:19.883798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:19.883798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:19.883798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:19.883798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:19.884546 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:19.886449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:19.972079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1152/2328] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:19 2021] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:19.976508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:19.986938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30faa3-dd47-46bf-b04b-7ecc4695c515 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.049323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.050075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.050393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.050684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.051430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.054032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:20.188254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1177/2329] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:19 2021] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:20.189551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:20.200165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe30855-b073-4274-996d-f9fbe350b0ee admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.204651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.205293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.205601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.205877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.206648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.208269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:20.220420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:20.222640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:20.225724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1153/2330] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:20.226656 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:20.236461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd32e-aaa1-4f01-b723-ba3303b5b2f9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.241979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.242679 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.242960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.243231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.243482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b237-9702-4eec-b38a-d3d3f54e4cac admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.244038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.245633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:20.248655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.249517 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.249808 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.250295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] PATH_INFO: `/v3/users/4514d443d8ce47308af5a772b5c6de57` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.258089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4514d443d8ce47308af5a772b5c6de57)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.258089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:20.258325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1154/2331] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:20.260862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:20.270695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534a3e-94fe-4c33-94e5-e5a6464e06a2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.277410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e64a2-2e89-4dcd-8da9-fe27d1e4c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.278316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e64a2-2e89-4dcd-8da9-fe27d1e4c386 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.278598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e64a2-2e89-4dcd-8da9-fe27d1e4c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.278873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e64a2-2e89-4dcd-8da9-fe27d1e4c386 admin admin] PATH_INFO: `/v3/projects/29992982ec2f4060b92f94ee18478bdc/users/f32d47c23b8048979dfdf7007006e537/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.294092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e64a2-2e89-4dcd-8da9-fe27d1e4c386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29992982ec2f4060b92f94ee18478bdc, user_id=f32d47c23b8048979dfdf7007006e537, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.297145 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e64a2-2e89-4dcd-8da9-fe27d1e4c386 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:20.454031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1155/2332] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:20 2021] PUT /identity/v3/projects/29992982ec2f4060b92f94ee18478bdc/users/f32d47c23b8048979dfdf7007006e537/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:20.464398 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.464716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.464998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.494465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4514d443d8ce47308af5a772b5c6de57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:20.504287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] MFA Rules not processed for user `f32d47c23b8048979dfdf7007006e537`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:20.506730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:20.510338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4514d443d8ce47308af5a772b5c6de57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:20.511116 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4514d443d8ce47308af5a772b5c6de57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:20.511734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4514d443d8ce47308af5a772b5c6de57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:20.519116 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4514d443d8ce47308af5a772b5c6de57'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:20.572025 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1156/2333] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:20 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:37:20.576318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:20.577743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:20.621499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1178/2334] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:20 2021] DELETE /identity/v3/users/4514d443d8ce47308af5a772b5c6de57 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:20.644917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e616a4-0dd5-402f-bc7f-1be6c7fb910f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.711566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.713265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.713790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.714274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.715436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.720184 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:20.803799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1157/2335] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:20 2021] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:20.808573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:20.821650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d26bc-69bd-4e08-a14d-f28da789a7e1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.859561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:20.867980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:20.906556 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.907240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.907525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.907801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.908514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.910481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:20.968324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d9190-84f7-40e4-84dd-2791c73c0ca6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:20.974080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:20.975157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:20.975469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:20.980413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] PATH_INFO: `/v3/projects/9f992c2ec055454ead0dacb22a5a1187` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:20.980413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f992c2ec055454ead0dacb22a5a1187)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:20.980413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.006479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1179/2336] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:20 2021] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:21.009945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.020423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aedeed-a107-4242-ba4c-dcd82457e312 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.025174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.025826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.026135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.026442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.027185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.028765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.039071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1180/2337] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:37:21.043098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.053233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad5137-a0f3-4f7d-9aba-d166a080af73 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.058126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.058986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.059271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.059548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] PATH_INFO: `/v3/projects/4d26ae14d5774ee481589ce863af9eab/users/3ff2b431f2db4aa3a1d4b623586159bf/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.074651 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d26ae14d5774ee481589ce863af9eab, user_id=3ff2b431f2db4aa3a1d4b623586159bf, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.077278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.202101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1181/2338] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:21 2021] PUT /identity/v3/projects/4d26ae14d5774ee481589ce863af9eab/users/3ff2b431f2db4aa3a1d4b623586159bf/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:21.206011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.210551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f992c2ec055454ead0dacb22a5a1187', 'request_id': 'req-96f1f27d-6d90-4b93-9e19-60fd9a046b56'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.216319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f992c2ec055454ead0dacb22a5a1187', 'request_id': 'req-96f1f27d-6d90-4b93-9e19-60fd9a046b56'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.267966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a14dc-b6d4-448a-895b-b2f4d4f215d1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.281539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f992c2ec055454ead0dacb22a5a1187', 'request_id': 'req-96f1f27d-6d90-4b93-9e19-60fd9a046b56'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.293929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] The token cache is being invalidate because project 9f992c2ec055454ead0dacb22a5a1187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:21.294256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.294890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-96f1f27d-6d90-4b93-9e19-60fd9a046b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.296432 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1158/2339] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:20 2021] DELETE /identity/v3/projects/9f992c2ec055454ead0dacb22a5a1187 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:21.302768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae2039-d21b-46ed-938a-51998f375b4e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.303075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae2039-d21b-46ed-938a-51998f375b4e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.303480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae2039-d21b-46ed-938a-51998f375b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.321867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b5ae2039-d21b-46ed-938a-51998f375b4e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:21.323077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b5ae2039-d21b-46ed-938a-51998f375b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:21.324399 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.325080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.325363 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.325645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.326424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.328016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.331322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1159/2340] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:37:21.339640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b8d9-f2bd-4a57-a091-e074a934f6ba None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.339933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b8d9-f2bd-4a57-a091-e074a934f6ba None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.340401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b8d9-f2bd-4a57-a091-e074a934f6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.345382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1182/2341] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:37:21.346307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.349600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:21.359449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5725b8d9-f2bd-4a57-a091-e074a934f6ba None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:21.360625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5725b8d9-f2bd-4a57-a091-e074a934f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:21.361984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b90cbb-c61b-477f-96d2-4b103d07aaa3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.367679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967c956-f93b-45cb-8029-ef11bbf9830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.368560 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967c956-f93b-45cb-8029-ef11bbf9830b admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.368845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967c956-f93b-45cb-8029-ef11bbf9830b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.369122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967c956-f93b-45cb-8029-ef11bbf9830b admin admin] PATH_INFO: `/v3/projects/4d26ae14d5774ee481589ce863af9eab/users/3ff2b431f2db4aa3a1d4b623586159bf/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.370212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1160/2342] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:37:21.371483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967c956-f93b-45cb-8029-ef11bbf9830b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d26ae14d5774ee481589ce863af9eab, user_id=3ff2b431f2db4aa3a1d4b623586159bf, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.374387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967c956-f93b-45cb-8029-ef11bbf9830b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.374532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725b8d9-f2bd-4a57-a091-e074a934f6ba None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.383775 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725b8d9-f2bd-4a57-a091-e074a934f6ba None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.385033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1183/2343] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:21 2021] PUT /identity/v3/projects/4d26ae14d5774ee481589ce863af9eab/users/3ff2b431f2db4aa3a1d4b623586159bf/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:21.397188 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.397572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.398133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.438238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] MFA Rules not processed for user `3ff2b431f2db4aa3a1d4b623586159bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:21.438238 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:21.482479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.483046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.483338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.483616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.484585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:37:21.484897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.486713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.500235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1161/2344] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:37:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:37:21.504202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.514118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbc191-c42d-48de-b171-0a6b2d066088 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.519876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.520757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.521138 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.521314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.522033 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.524639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.528387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1184/2345] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:21 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:21.540351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.541788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:21.598053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ca394-0f6e-4d5c-99dd-b6b37bcdee88 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.602723 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.603446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.603730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.604006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.612930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.615505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.621100 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1162/2346] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:21 2021] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:21.625160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1185/2347] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:21 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:37:21.625466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.655103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.666684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a7f7-2ee8-42ce-a177-017fcb498a4d service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.689691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc5f7f-b1c5-4766-b2dc-8653b36e9820 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.694983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.695651 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.695933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.696207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.696916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.698862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.723136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.724819 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.725096 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.725368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] PATH_INFO: `/v3/users/f32d47c23b8048979dfdf7007006e537` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.726609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32d47c23b8048979dfdf7007006e537)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.728535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.796481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1163/2348] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:21 2021] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:21.800354 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.810038 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbea591-0d4d-4edd-be5c-42bde0eed6e9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.814699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.815337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.815617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.815896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.816647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.818472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.828492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1164/2349] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:37:21.832306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.843053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611b07-73c2-4a9f-bb5f-cd393125f853 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.850055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.850736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.851022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.851303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.852046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.853685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.866911 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1165/2350] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:37:21.871156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:21.881879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa751-2134-4d38-b522-afb441e9b4fb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:21.886863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecad76f-8423-4677-bb0a-0ceaa3484433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:21.887741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad76f-8423-4677-bb0a-0ceaa3484433 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:21.888025 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad76f-8423-4677-bb0a-0ceaa3484433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:21.888298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad76f-8423-4677-bb0a-0ceaa3484433 admin admin] PATH_INFO: `/v3/projects/879f0a1ecdb7480b90d97e4531b9ff6d/users/98f235f4cb944eb6926375e2bb551741/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:21.903847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32d47c23b8048979dfdf7007006e537'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.918492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecad76f-8423-4677-bb0a-0ceaa3484433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879f0a1ecdb7480b90d97e4531b9ff6d, user_id=98f235f4cb944eb6926375e2bb551741, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:21.918492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecad76f-8423-4677-bb0a-0ceaa3484433 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:21.918734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32d47c23b8048979dfdf7007006e537'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.918734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32d47c23b8048979dfdf7007006e537'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.918734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32d47c23b8048979dfdf7007006e537'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:21.925545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a900cb2d-03ed-411c-a536-cbb8625064e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32d47c23b8048979dfdf7007006e537'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:22.017206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1166/2351] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:21 2021] PUT /identity/v3/projects/879f0a1ecdb7480b90d97e4531b9ff6d/users/98f235f4cb944eb6926375e2bb551741/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:22.022963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:22.023253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:22.023532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:22.033602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1186/2352] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:21 2021] DELETE /identity/v3/users/f32d47c23b8048979dfdf7007006e537 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:22.038370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:22.038669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:22.038951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:22.040617 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:22.041788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:22.056340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:22.057435 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:22.100240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1167/2353] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:37:22.110357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:22.111653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:22.115210 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1187/2354] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:22.127575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:22.128915 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:22.169361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640a71c-9654-4e8c-b5e2-09e30a1860be None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:22.173156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:22.173827 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:22.174113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:22.174420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:22.183825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:22.185281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:22.186118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22819-299b-4242-b1fa-beb3b06a1248 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:22.190030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:22.190703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:22.190991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:22.191272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:22.195494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1168/2355] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:37:22.201305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:22.202790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:22.218593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1188/2356] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:37:22.649983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:22.651477 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:22.666287 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393adb96-f217-4cb7-9ac6-c4c3a401ccbb service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:22.671027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:22.671876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:22.672154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:22.672430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] PATH_INFO: `/v3/projects/29992982ec2f4060b92f94ee18478bdc` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:22.673644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29992982ec2f4060b92f94ee18478bdc)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:22.675592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:22.785863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29992982ec2f4060b92f94ee18478bdc', 'request_id': 'req-e71ada8a-bd98-4833-8356-c73c299aa8a8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:22.791989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29992982ec2f4060b92f94ee18478bdc', 'request_id': 'req-e71ada8a-bd98-4833-8356-c73c299aa8a8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:22.847863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29992982ec2f4060b92f94ee18478bdc', 'request_id': 'req-e71ada8a-bd98-4833-8356-c73c299aa8a8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:22.859634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] The token cache is being invalidate because project 29992982ec2f4060b92f94ee18478bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:22.859928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:22.860550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:22.862078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1169/2357] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:22 2021] DELETE /identity/v3/projects/29992982ec2f4060b92f94ee18478bdc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:22.866738 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:22.876394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55c89-9ef2-48c6-a63e-de6f6acb8ad7 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:22.934071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:22.934968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:22.935254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:22.935530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] PATH_INFO: `/v3/users/3ff2b431f2db4aa3a1d4b623586159bf` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:22.936747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff2b431f2db4aa3a1d4b623586159bf)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:22.938695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:23.153055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff2b431f2db4aa3a1d4b623586159bf'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.165624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff2b431f2db4aa3a1d4b623586159bf'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.166660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff2b431f2db4aa3a1d4b623586159bf'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.167271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff2b431f2db4aa3a1d4b623586159bf'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.174120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3c05d524-02ab-4d4c-872d-3339a8b70aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff2b431f2db4aa3a1d4b623586159bf'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.230510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1189/2358] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:22 2021] DELETE /identity/v3/users/3ff2b431f2db4aa3a1d4b623586159bf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:23.679034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:23.681198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:23.697904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ada8a-bd98-4833-8356-c73c299aa8a8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:23.767680 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:23.768729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:23.769009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:23.769283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] PATH_INFO: `/v3/projects/4d26ae14d5774ee481589ce863af9eab` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:23.770600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d26ae14d5774ee481589ce863af9eab)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:23.773067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:23.871676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d26ae14d5774ee481589ce863af9eab', 'request_id': 'req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.877518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d26ae14d5774ee481589ce863af9eab', 'request_id': 'req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.973666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d26ae14d5774ee481589ce863af9eab', 'request_id': 'req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.986957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] The token cache is being invalidate because project 4d26ae14d5774ee481589ce863af9eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:23.987244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.987885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a5b8c30d-26d6-4ff8-874f-7599aee8a9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:23.989691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1170/2359] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:23 2021] DELETE /identity/v3/projects/4d26ae14d5774ee481589ce863af9eab => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:23.995788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2757d-cc68-494b-bba8-d92f4167c7d1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:23.996316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2757d-cc68-494b-bba8-d92f4167c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:23.996445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2757d-cc68-494b-bba8-d92f4167c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.030093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-08b2757d-cc68-494b-bba8-d92f4167c7d1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:24.031400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-08b2757d-cc68-494b-bba8-d92f4167c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:24.096224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1190/2360] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:24.104536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963889-5a6b-44ae-bde3-ff073c6d1b93 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.104823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963889-5a6b-44ae-bde3-ff073c6d1b93 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.105271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963889-5a6b-44ae-bde3-ff073c6d1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.131829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4d963889-5a6b-44ae-bde3-ff073c6d1b93 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:24.133103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4d963889-5a6b-44ae-bde3-ff073c6d1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:24.143164 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1171/2361] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:24.148187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2757d-cc68-494b-bba8-d92f4167c7d1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:24.158252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2757d-cc68-494b-bba8-d92f4167c7d1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:24.163899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:24.164829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.165264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.165690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.166636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:37:24.166937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:24.168758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:24.188009 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1191/2362] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:37:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:37:24.192002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d963889-5a6b-44ae-bde3-ff073c6d1b93 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:24.201928 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d963889-5a6b-44ae-bde3-ff073c6d1b93 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:24.207261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:24.207917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.208203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.208533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.209247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:24.211228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:24.307995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1172/2363] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:24 2021] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:24.308662 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:24.324742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9ca05-b868-472d-8205-0f8b35aa87cf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:24.428480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:24.429329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.429721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.430103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.430972 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:24.437052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:24.560122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1192/2364] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:24 2021] POST /identity/v3/users => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:24.564616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:24.582269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1047-2503-4a6c-b17b-016c077ec067 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:24.592270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:24.594107 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.594777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.595229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.596950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:24.613535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:24.685499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:24.685721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1173/2365] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:24.716316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab957826-229a-4c8a-b46b-37c9b0272b72 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:24.726370 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75c8e3-3d36-4363-b2cf-9e945cbcf0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:24.727080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75c8e3-3d36-4363-b2cf-9e945cbcf0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.727373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75c8e3-3d36-4363-b2cf-9e945cbcf0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.727846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75c8e3-3d36-4363-b2cf-9e945cbcf0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.728920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75c8e3-3d36-4363-b2cf-9e945cbcf0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:24.730570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75c8e3-3d36-4363-b2cf-9e945cbcf0b5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:24.741939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1193/2366] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:24.746493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:24.769841 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6d08d-968b-4846-b105-21d38a827fee admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:24.775433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:24.776506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.777092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.777662 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] PATH_INFO: `/v3/projects/a022670a502340c2bd67e5c29b91e61b/users/737701b148a747428f7e9b265463a49b/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.795496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a022670a502340c2bd67e5c29b91e61b, user_id=737701b148a747428f7e9b265463a49b, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:24.798625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:24.898443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1174/2367] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:24 2021] PUT /identity/v3/projects/a022670a502340c2bd67e5c29b91e61b/users/737701b148a747428f7e9b265463a49b/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:24.905995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901556b-c4b0-408d-bb4a-e6b8ff685d3f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:24.906359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901556b-c4b0-408d-bb4a-e6b8ff685d3f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:24.906641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901556b-c4b0-408d-bb4a-e6b8ff685d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:24.933468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a901556b-c4b0-408d-bb4a-e6b8ff685d3f None None] MFA Rules not processed for user `737701b148a747428f7e9b265463a49b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:24.934828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a901556b-c4b0-408d-bb4a-e6b8ff685d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:25.011813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1194/2368] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:24 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:25.016359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:25.088320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8e760-8bcd-4a45-b8b2-15d62c90de0a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:25.093195 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:25.093953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:25.094341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:25.094694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:25.095473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:25.097454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:25.212853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1175/2369] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:25 2021] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:25.216980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901556b-c4b0-408d-bb4a-e6b8ff685d3f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:25.229892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901556b-c4b0-408d-bb4a-e6b8ff685d3f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:25.300512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:25.301729 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:25.306211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:25.306211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:25.306211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:25.309150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:25.502569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1195/2370] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:25 2021] POST /identity/v3/users => generated 306 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:25.503380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:25.504885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42fb2-78dc-4ebe-98de-8c2cab43cb3f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:25.514627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:25.515319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:25.515771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:25.516059 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:25.517087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:25.518878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:25.541440 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:25.545465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1176/2371] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:25 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:25.560920 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6ce1c-eaa7-4286-b9be-9c3286eff07a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:25.567404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:25.569014 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:25.569309 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:25.569799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] PATH_INFO: `/v3/projects/794b6d3cb9114a4386a621d31873d07d/users/1d5972ee67ce4c38a442333948c14278/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:25.586457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] RBAC: Authorizing `identity:create_grant(project_id=794b6d3cb9114a4386a621d31873d07d, user_id=1d5972ee67ce4c38a442333948c14278, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:25.589591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:25.683118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1196/2372] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:25 2021] PUT /identity/v3/projects/794b6d3cb9114a4386a621d31873d07d/users/1d5972ee67ce4c38a442333948c14278/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:25.687206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:25.697736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921bed4-6f58-44a4-a857-c9a2b454c64a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:25.755419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad44fc-8b2b-443c-ab54-0804187e45b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:25.756243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad44fc-8b2b-443c-ab54-0804187e45b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:25.756530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad44fc-8b2b-443c-ab54-0804187e45b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:25.756830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad44fc-8b2b-443c-ab54-0804187e45b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:25.757579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad44fc-8b2b-443c-ab54-0804187e45b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:25.759220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad44fc-8b2b-443c-ab54-0804187e45b6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:25.778226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1177/2373] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:25 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:25.779462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:25.794817 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce37c6-1f54-4698-b179-6c1edd32206e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:25.800668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:25.801635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:25.803057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:25.803635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] PATH_INFO: `/v3/projects/794b6d3cb9114a4386a621d31873d07d/users/1d5972ee67ce4c38a442333948c14278/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:25.805690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794b6d3cb9114a4386a621d31873d07d, user_id=1d5972ee67ce4c38a442333948c14278, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:25.808703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:25.821403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1197/2374] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:25 2021] PUT /identity/v3/projects/794b6d3cb9114a4386a621d31873d07d/users/1d5972ee67ce4c38a442333948c14278/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:25.832124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc9f73-6e6f-4610-a49b-cba49665f514 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:25.832124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc9f73-6e6f-4610-a49b-cba49665f514 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:25.832332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc9f73-6e6f-4610-a49b-cba49665f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:25.868015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5efc9f73-6e6f-4610-a49b-cba49665f514 None None] MFA Rules not processed for user `1d5972ee67ce4c38a442333948c14278`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:25.869244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5efc9f73-6e6f-4610-a49b-cba49665f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:25.994324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1178/2375] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:25 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:26.007059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:26.008727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:26.108979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b247ea-c9cc-44a7-ad6c-fe1c32459281 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:26.113841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e3d27-1684-4bdf-9c23-6729a140efb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:26.115143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3d27-1684-4bdf-9c23-6729a140efb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:26.115802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3d27-1684-4bdf-9c23-6729a140efb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:26.116248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3d27-1684-4bdf-9c23-6729a140efb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:26.133235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e3d27-1684-4bdf-9c23-6729a140efb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:26.136564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e3d27-1684-4bdf-9c23-6729a140efb4 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:26.149262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1198/2376] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:26 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:26.371143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc9f73-6e6f-4610-a49b-cba49665f514 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:26.384123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc9f73-6e6f-4610-a49b-cba49665f514 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:26.393890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:26.394641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:26.395219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:26.395676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:26.497048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:26.498551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:26.508743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1179/2377] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:26 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:27.976640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a35b02-26dd-4bea-92ea-9d7db1235c05 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:27.977804 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a35b02-26dd-4bea-92ea-9d7db1235c05 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:27.978311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a35b02-26dd-4bea-92ea-9d7db1235c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:28.013292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-13a35b02-26dd-4bea-92ea-9d7db1235c05 None None] MFA Rules not processed for user `98f235f4cb944eb6926375e2bb551741`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:28.014656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-13a35b02-26dd-4bea-92ea-9d7db1235c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:28.086708 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1199/2378] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:27 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:28.098726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:28.100941 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:28.183147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c34c-5b7a-42aa-bee9-6ca80b1750c5 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:28.189021 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:28.189691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:28.190053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:28.190432 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:28.199646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:28.201250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:28.211725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1180/2379] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:28 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:30.852943 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d38ef9-5e32-4572-8114-a39f2eada079 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:30.853419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d38ef9-5e32-4572-8114-a39f2eada079 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:30.853546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d38ef9-5e32-4572-8114-a39f2eada079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:30.879537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-17d38ef9-5e32-4572-8114-a39f2eada079 None None] MFA Rules not processed for user `98f235f4cb944eb6926375e2bb551741`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:30.885219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-17d38ef9-5e32-4572-8114-a39f2eada079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:30.902740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1200/2380] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:30 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:32.968451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:32.969892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:33.035910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c635-b2d2-45d8-a45a-4d3b91f21d2b service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:33.041103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:33.041967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:33.042283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:33.042566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] PATH_INFO: `/v3/users/01cff8b374c842d6a8be137e0bdd0394` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:33.043765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cff8b374c842d6a8be137e0bdd0394)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:33.045683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:33.287575 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cff8b374c842d6a8be137e0bdd0394'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:33.288312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cff8b374c842d6a8be137e0bdd0394'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:33.300478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cff8b374c842d6a8be137e0bdd0394'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:33.301142 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cff8b374c842d6a8be137e0bdd0394'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:33.425155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cff8b374c842d6a8be137e0bdd0394'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:33.439007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1181/2381] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:32 2021] DELETE /identity/v3/users/01cff8b374c842d6a8be137e0bdd0394 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:33.444028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:33.444533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:33.444643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:33.462072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:33.463276 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:33.518237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1201/2382] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:37:33.529158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:33.531061 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:33.593246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61ed04-f367-4699-be65-9c73a90d6e79 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:33.597114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:33.597823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:33.598104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:33.598424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:33.607817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:33.609258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:33.619473 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1182/2383] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:34.125079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:34.126801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:34.139049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d5a3b-a76e-413c-9493-3edb73a0a3b8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:34.143879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:34.144727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.145012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.145290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] PATH_INFO: `/v3/users/737701b148a747428f7e9b265463a49b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.146971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737701b148a747428f7e9b265463a49b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:34.148879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:34.165907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:34.170786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:34.184992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f371-4af7-4432-a169-315755d3f4f7 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:34.190821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:34.191602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.191906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.192181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] PATH_INFO: `/v3/projects/9f44bb70e4034cf4895efc1d9c1ac6b7` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.193414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f44bb70e4034cf4895efc1d9c1ac6b7)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:34.195355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:34.489269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737701b148a747428f7e9b265463a49b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.492814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f44bb70e4034cf4895efc1d9c1ac6b7', 'request_id': 'req-1dac9202-6e9c-469c-bf42-833e46d97106'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.498752 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f44bb70e4034cf4895efc1d9c1ac6b7', 'request_id': 'req-1dac9202-6e9c-469c-bf42-833e46d97106'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.502735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737701b148a747428f7e9b265463a49b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.503464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737701b148a747428f7e9b265463a49b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.504086 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737701b148a747428f7e9b265463a49b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.511618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-03d494f1-ea0e-4f68-85c7-e393cc253626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737701b148a747428f7e9b265463a49b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.593314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f44bb70e4034cf4895efc1d9c1ac6b7', 'request_id': 'req-1dac9202-6e9c-469c-bf42-833e46d97106'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.607434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] The token cache is being invalidate because project 9f44bb70e4034cf4895efc1d9c1ac6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:34.607987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.608792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dac9202-6e9c-469c-bf42-833e46d97106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:34.610701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1183/2384] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:34 2021] DELETE /identity/v3/projects/9f44bb70e4034cf4895efc1d9c1ac6b7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:34.617719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729b9f-2476-4743-b44b-6753d357c92b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.618683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729b9f-2476-4743-b44b-6753d357c92b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.619210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729b9f-2476-4743-b44b-6753d357c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.640249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2f729b9f-2476-4743-b44b-6753d357c92b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:34.641806 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2f729b9f-2476-4743-b44b-6753d357c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:34.713382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1184/2385] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:34.715219 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3e25c-6569-4680-82d6-9e65202aeac0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.717067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3e25c-6569-4680-82d6-9e65202aeac0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.717550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3e25c-6569-4680-82d6-9e65202aeac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.721344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1202/2386] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:34 2021] DELETE /identity/v3/users/737701b148a747428f7e9b265463a49b => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:34.725498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.725824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.726150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.739293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fbe3e25c-6569-4680-82d6-9e65202aeac0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:34.740506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fbe3e25c-6569-4680-82d6-9e65202aeac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:34.751094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:34.752336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:34.804014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1185/2387] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:34.805337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3e25c-6569-4680-82d6-9e65202aeac0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:34.812706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1203/2388] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:34.814969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3e25c-6569-4680-82d6-9e65202aeac0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:34.820631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:34.821137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.821443 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.821714 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.822509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:37:34.822837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:34.824537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:34.825358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:34.826966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:34.844144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1186/2389] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:37:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:37:34.848307 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:34.860213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576e81a-770b-454a-b86a-c39e72a6afb2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:34.865831 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:34.867472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.867864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.868242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.869123 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:34.871168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:34.916376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa40304-2a19-437f-be96-229267c9e453 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:34.920084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:34.920720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:34.921024 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:34.921278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:34.930431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:34.931898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:34.941404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1204/2390] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:35.007677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1187/2391] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:34 2021] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:35.011523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:35.022510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14fb4d-fbae-4c56-9cf0-b519940bd50a service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:35.092212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:35.093020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:35.093437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:35.093953 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:35.094921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:35.097180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:35.287978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1205/2392] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:35 2021] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:35.289436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:35.300242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631325a-63c3-4622-a01a-4fe808a3165b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:35.305522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:35.306211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:35.306501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:35.306780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:35.307527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:35.309124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:35.320719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1188/2393] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:35.329505 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:35.356268 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1f7e1-567f-44f1-ba2e-28f4803eede7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:35.363595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d3f27-f27c-46a4-ad87-44d5a9d83c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:35.364535 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3f27-f27c-46a4-ad87-44d5a9d83c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:35.365041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3f27-f27c-46a4-ad87-44d5a9d83c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:35.365511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3f27-f27c-46a4-ad87-44d5a9d83c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:35.368493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d3f27-f27c-46a4-ad87-44d5a9d83c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:35.371012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d3f27-f27c-46a4-ad87-44d5a9d83c3b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:35.389052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1206/2394] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:35 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:35.390670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:35.405963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099751d1-6d1b-4335-9069-005bae74bbaa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:35.412221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:35.414402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:35.415129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:35.415845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] PATH_INFO: `/v3/projects/d1cb05526ae849ac84ad82d75d80cec0/users/fd0759370c8540dfaa3a9367fd1d15f6/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:35.433370 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cb05526ae849ac84ad82d75d80cec0, user_id=fd0759370c8540dfaa3a9367fd1d15f6, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:35.436401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:35.565760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1189/2395] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:35 2021] PUT /identity/v3/projects/d1cb05526ae849ac84ad82d75d80cec0/users/fd0759370c8540dfaa3a9367fd1d15f6/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:35.576045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:35.576514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:35.576614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:35.598533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:35.600365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:35.607350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] MFA Rules not processed for user `fd0759370c8540dfaa3a9367fd1d15f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:35.609358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:35.701562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1207/2396] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:35 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:37:35.710305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c231587-cf0f-4903-b306-8b703debb514 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:35.710305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:35.710305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:35.710723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:35.710952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] PATH_INFO: `/v3/projects/a022670a502340c2bd67e5c29b91e61b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:35.712639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a022670a502340c2bd67e5c29b91e61b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:35.713885 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:35.714612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:35.716310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:35.792683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f589e-cda9-4979-8dde-983cd48760a7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:35.797054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:35.797710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:35.797991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:35.798297 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:35.808962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:35.810522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:35.820491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1208/2397] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:35 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:35.852532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a022670a502340c2bd67e5c29b91e61b', 'request_id': 'req-941129c5-d7d2-4ea7-b291-156802f4cdb5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:35.861153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a022670a502340c2bd67e5c29b91e61b', 'request_id': 'req-941129c5-d7d2-4ea7-b291-156802f4cdb5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:35.962395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a022670a502340c2bd67e5c29b91e61b', 'request_id': 'req-941129c5-d7d2-4ea7-b291-156802f4cdb5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:35.977614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] The token cache is being invalidate because project a022670a502340c2bd67e5c29b91e61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:35.977614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:35.978254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-941129c5-d7d2-4ea7-b291-156802f4cdb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:35.979905 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1190/2398] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:35 2021] DELETE /identity/v3/projects/a022670a502340c2bd67e5c29b91e61b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:35.984070 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:35.999754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44fef-3701-45cc-b3af-9df8124b64ce service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:36.061735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:36.062634 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:36.063140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:36.063357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] PATH_INFO: `/v3/users/1d5972ee67ce4c38a442333948c14278` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:36.064612 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5972ee67ce4c38a442333948c14278)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:36.066560 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:36.360421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5972ee67ce4c38a442333948c14278'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:36.372814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5972ee67ce4c38a442333948c14278'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:36.373531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5972ee67ce4c38a442333948c14278'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:36.374168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5972ee67ce4c38a442333948c14278'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:36.381122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5972ee67ce4c38a442333948c14278'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:36.789953 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1209/2399] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:37:35 2021] DELETE /identity/v3/users/1d5972ee67ce4c38a442333948c14278 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:37.113690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e0ad-ee18-447f-a9ee-df322dfa1345 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:37.114250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e0ad-ee18-447f-a9ee-df322dfa1345 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:37.114250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e0ad-ee18-447f-a9ee-df322dfa1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:37.150048 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-70c7e0ad-ee18-447f-a9ee-df322dfa1345 None None] MFA Rules not processed for user `9cec710bddca4e6c890c99580d172053`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:37.153933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-70c7e0ad-ee18-447f-a9ee-df322dfa1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:37.230763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1191/2400] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:37 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:38.172054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:38.174424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:38.267763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b0bd-f995-4190-ad0d-4be1451d06d3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:38.272494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:38.274493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:38.274783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:38.276936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] PATH_INFO: `/v3/projects/794b6d3cb9114a4386a621d31873d07d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:38.278291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=794b6d3cb9114a4386a621d31873d07d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:38.280391 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:38.437890 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794b6d3cb9114a4386a621d31873d07d', 'request_id': 'req-33cad15e-bc41-470a-ae78-93d7f624e0ac'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:38.444348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794b6d3cb9114a4386a621d31873d07d', 'request_id': 'req-33cad15e-bc41-470a-ae78-93d7f624e0ac'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:38.550134 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794b6d3cb9114a4386a621d31873d07d', 'request_id': 'req-33cad15e-bc41-470a-ae78-93d7f624e0ac'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:38.561124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] The token cache is being invalidate because project 794b6d3cb9114a4386a621d31873d07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:37:38.561417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:38.562048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33cad15e-bc41-470a-ae78-93d7f624e0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:37:38.563657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1210/2401] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:37:38 2021] DELETE /identity/v3/projects/794b6d3cb9114a4386a621d31873d07d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:38.570616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a79f74-a12c-45b9-aebc-69929d3daca2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:38.571106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a79f74-a12c-45b9-aebc-69929d3daca2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:38.571394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a79f74-a12c-45b9-aebc-69929d3daca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:38.590309 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f7a79f74-a12c-45b9-aebc-69929d3daca2 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:38.591598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f7a79f74-a12c-45b9-aebc-69929d3daca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:38.649530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1192/2402] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:38.657380 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98696c9-dedf-43d3-acc6-3eb1bfef5f7f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:38.662820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98696c9-dedf-43d3-acc6-3eb1bfef5f7f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:38.662820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98696c9-dedf-43d3-acc6-3eb1bfef5f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:38.677581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e98696c9-dedf-43d3-acc6-3eb1bfef5f7f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:38.679082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e98696c9-dedf-43d3-acc6-3eb1bfef5f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:38.691113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1211/2403] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:38.695893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a79f74-a12c-45b9-aebc-69929d3daca2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:38.709536 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a79f74-a12c-45b9-aebc-69929d3daca2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:38.715222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:38.715878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:38.720811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:38.720811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:38.720811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:37:38.720811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:38.720811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:38.730951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1193/2404] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:37:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:37:38.735524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98696c9-dedf-43d3-acc6-3eb1bfef5f7f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:38.744728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98696c9-dedf-43d3-acc6-3eb1bfef5f7f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:38.749760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:38.750455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:38.750736 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:38.751012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:38.751714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:38.753758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:38.867929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1212/2405] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:38 2021] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:38.871786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:38.882643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7be52-1ea6-4883-814d-6892296e068d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:38.948904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:38.950121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:38.950121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:38.950516 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:38.951056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:38.953126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:39.049078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1194/2406] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:38 2021] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:39.053082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:39.064643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95160b9-f79c-4751-bfc1-fbf12c1d710a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:39.071031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:39.071703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:39.071986 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:39.072260 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:39.073003 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:39.074960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:39.085537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1213/2407] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:37:39.089426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:39.099554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a91ed-c5fa-4820-9db5-a0339077d3bf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:39.104770 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1ced3-3264-4906-8388-63c6e0d100b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:39.105433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1ced3-3264-4906-8388-63c6e0d100b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:39.105718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1ced3-3264-4906-8388-63c6e0d100b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:39.105998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1ced3-3264-4906-8388-63c6e0d100b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:39.106829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1ced3-3264-4906-8388-63c6e0d100b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:39.108428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1ced3-3264-4906-8388-63c6e0d100b9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:39.119103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1195/2408] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:39.123492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:39.134311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4fabd-3700-4924-a199-a1bebb4b8d4d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:39.139269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:39.140255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:39.140584 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:39.140867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] PATH_INFO: `/v3/projects/ca6098612cf34bd49106135584f66f8b/users/f5e8703d480b4441a37487c96605b159/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:39.158151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6098612cf34bd49106135584f66f8b, user_id=f5e8703d480b4441a37487c96605b159, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:39.160887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:39.248594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1214/2409] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:39 2021] PUT /identity/v3/projects/ca6098612cf34bd49106135584f66f8b/users/f5e8703d480b4441a37487c96605b159/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:37:39.253899 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a8ae9-050a-4d49-9c76-6ba50c43e8d2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:39.254313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a8ae9-050a-4d49-9c76-6ba50c43e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:39.258671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a8ae9-050a-4d49-9c76-6ba50c43e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:39.274519 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-dc1a8ae9-050a-4d49-9c76-6ba50c43e8d2 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:39.275738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-dc1a8ae9-050a-4d49-9c76-6ba50c43e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:39.334328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1196/2410] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:39.344750 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:39.346508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:39.404647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746394-f243-4d56-a3fc-dfcf72c406ee admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:39.408385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:39.409144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:39.409383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:39.409658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:39.419969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:39.421470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:39.431253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1215/2411] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:40.883743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05ea8-7285-4bcd-8065-90e76113f7d9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:40.884288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05ea8-7285-4bcd-8065-90e76113f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:40.884397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05ea8-7285-4bcd-8065-90e76113f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:40.911986 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0ec05ea8-7285-4bcd-8065-90e76113f7d9 None None] MFA Rules not processed for user `f5e8703d480b4441a37487c96605b159`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:40.913716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0ec05ea8-7285-4bcd-8065-90e76113f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:40.976562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1197/2412] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:40 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:40.980950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:40.990800 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709216e-e7b6-45e8-bf5f-06f07d35a5ae service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:40.996131 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:40.996799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:40.997090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:40.997374 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:40.998104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:41.000056 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:41.183615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1216/2413] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:37:40 2021] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:37:41.188008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05ea8-7285-4bcd-8065-90e76113f7d9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:41.195614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05ea8-7285-4bcd-8065-90e76113f7d9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:41.258860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:41.259533 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:41.259817 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:41.260095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:41.260851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:41.262799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:41.350233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1198/2414] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:37:41 2021] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:37:41.354352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:41.365549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cab35-4c7b-43fa-b1d8-70919d63b237 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:41.372740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:41.373840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:41.374231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:41.374685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:41.375704 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:41.377984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:41.397300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1217/2415] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:37:41.398922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:41.408743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d989-f03b-4eae-beba-05ccdef2d55b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:41.414453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:41.415335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:41.415621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:41.415895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] PATH_INFO: `/v3/projects/120eee556e324b848e26cef484b3862a/users/64d4f7b812dd444d90cfcbbbc3f304d9/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:41.430468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120eee556e324b848e26cef484b3862a, user_id=64d4f7b812dd444d90cfcbbbc3f304d9, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:41.433216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:41.540417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1199/2416] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:41 2021] PUT /identity/v3/projects/120eee556e324b848e26cef484b3862a/users/64d4f7b812dd444d90cfcbbbc3f304d9/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:41.544338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:41.555954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71b35b-0c49-47f5-be56-f92a31fb4dac admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:41.610010 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff11d6c-86ca-43ec-b212-d2562f5a7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:41.610696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff11d6c-86ca-43ec-b212-d2562f5a7fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:41.610979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff11d6c-86ca-43ec-b212-d2562f5a7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:41.611262 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff11d6c-86ca-43ec-b212-d2562f5a7fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:41.612005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff11d6c-86ca-43ec-b212-d2562f5a7fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:41.613592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff11d6c-86ca-43ec-b212-d2562f5a7fa6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:41.623987 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1218/2417] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:37:41 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:37:41.629964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:41.641906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3709e-53f5-47f5-a91d-818287bd2171 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:41.646821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:41.647981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:41.648348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:41.648634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] PATH_INFO: `/v3/projects/120eee556e324b848e26cef484b3862a/users/64d4f7b812dd444d90cfcbbbc3f304d9/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:41.650682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120eee556e324b848e26cef484b3862a, user_id=64d4f7b812dd444d90cfcbbbc3f304d9, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:41.653313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:41.664369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1200/2418] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:37:41 2021] PUT /identity/v3/projects/120eee556e324b848e26cef484b3862a/users/64d4f7b812dd444d90cfcbbbc3f304d9/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:37:43.039737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:43.040285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:43.040411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:43.092061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] MFA Rules not processed for user `64d4f7b812dd444d90cfcbbbc3f304d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:37:43.093315 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:43.169263 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1219/2419] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:37:43 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:37:43.180017 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:43.181963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:43.239823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a357b-3192-4190-b7d4-08eedaefe4f6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:43.244545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:43.245480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:43.245480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:43.245747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:43.306353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:43.308054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:43.317397 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1201/2420] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:43 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:37:52.413313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:37:52.417736 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:37:52.427129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379f1a-ad9b-4fc6-b175-181c665cefb7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:37:52.430937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445589e-c307-4268-b9d4-92f2056ecc1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:37:52.431681 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445589e-c307-4268-b9d4-92f2056ecc1d service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:37:52.432365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445589e-c307-4268-b9d4-92f2056ecc1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:37:52.432649 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445589e-c307-4268-b9d4-92f2056ecc1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:37:52.442272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445589e-c307-4268-b9d4-92f2056ecc1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:37:52.443788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445589e-c307-4268-b9d4-92f2056ecc1d service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:37:52.453989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1220/2421] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:37:52 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:03.686314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:03.687791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:03.765416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03d71-c7bd-4477-b094-4e9dc2f3c1f7 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:03.770468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:03.771350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:03.771774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:03.772066 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] PATH_INFO: `/v3/users/fd0759370c8540dfaa3a9367fd1d15f6` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:03.773511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0759370c8540dfaa3a9367fd1d15f6)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:03.775692 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:03.957653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0759370c8540dfaa3a9367fd1d15f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:03.958341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0759370c8540dfaa3a9367fd1d15f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:03.969761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0759370c8540dfaa3a9367fd1d15f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:03.970419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0759370c8540dfaa3a9367fd1d15f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:04.039033 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0759370c8540dfaa3a9367fd1d15f6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:04.053262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1202/2422] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:03 2021] DELETE /identity/v3/users/fd0759370c8540dfaa3a9367fd1d15f6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:04.059806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:04.059806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:04.059806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:04.078837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:04.080023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:04.140192 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1221/2423] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:04.150265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:04.152321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:04.206822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d797501-3ba1-4d38-ac22-138c3a1c4d02 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:04.210682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:04.211293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:04.211577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:04.212039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:04.222327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:04.223804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:04.233901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1203/2424] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:04.714094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:04.716133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:04.728150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac654fd8-f80f-4511-ad91-44bc5cc89481 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:04.733444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:04.739640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:04.739640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:04.739640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] PATH_INFO: `/v3/projects/d1cb05526ae849ac84ad82d75d80cec0` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:04.739640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cb05526ae849ac84ad82d75d80cec0)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:04.739640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:04.875551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cb05526ae849ac84ad82d75d80cec0', 'request_id': 'req-43c8090e-3f10-425a-adfb-594a087c7174'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:04.883022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cb05526ae849ac84ad82d75d80cec0', 'request_id': 'req-43c8090e-3f10-425a-adfb-594a087c7174'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.004629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cb05526ae849ac84ad82d75d80cec0', 'request_id': 'req-43c8090e-3f10-425a-adfb-594a087c7174'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.016253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] The token cache is being invalidate because project d1cb05526ae849ac84ad82d75d80cec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:05.016548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.017476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43c8090e-3f10-425a-adfb-594a087c7174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.019050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1222/2425] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:04 2021] DELETE /identity/v3/projects/d1cb05526ae849ac84ad82d75d80cec0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:05.372815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:05.374361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:05.387991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef505492-ef7c-4a4b-b6cf-44cceb134eb9 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:05.443675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:05.444659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:05.444969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:05.445244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] PATH_INFO: `/v3/users/1c7ef1787aeb4430b9a11d41319b8ad3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:05.446483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7ef1787aeb4430b9a11d41319b8ad3)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:05.448436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:05.638671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7ef1787aeb4430b9a11d41319b8ad3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.639848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7ef1787aeb4430b9a11d41319b8ad3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.654368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7ef1787aeb4430b9a11d41319b8ad3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.655188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7ef1787aeb4430b9a11d41319b8ad3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.750053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7ef1787aeb4430b9a11d41319b8ad3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:05.765805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1204/2426] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:05 2021] DELETE /identity/v3/users/1c7ef1787aeb4430b9a11d41319b8ad3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:05.767801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:05.768282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:05.768393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:05.788548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:05.789675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:05.876128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1223/2427] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:05.885991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:05.887644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:05.946822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2033d7-775e-4a70-b766-a40851cf2811 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:05.950627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98438bc0-6070-4f17-8283-da6d2616761f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:05.951274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98438bc0-6070-4f17-8283-da6d2616761f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:05.951559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98438bc0-6070-4f17-8283-da6d2616761f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:05.951840 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98438bc0-6070-4f17-8283-da6d2616761f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:05.961446 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98438bc0-6070-4f17-8283-da6d2616761f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:05.962920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98438bc0-6070-4f17-8283-da6d2616761f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:05.973226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1205/2428] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:06.397698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:06.399344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:06.412625 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd461-e60c-4875-9a73-8aea3db48b00 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:06.417209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:06.418930 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:06.419224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:06.419503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] PATH_INFO: `/v3/projects/bd02894e57eb4965bf27a76a98ba95ec` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:06.420872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd02894e57eb4965bf27a76a98ba95ec)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:06.423214 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:06.551888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd02894e57eb4965bf27a76a98ba95ec', 'request_id': 'req-b693a20e-e430-4fbc-ab22-37253b87e68c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:06.558164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd02894e57eb4965bf27a76a98ba95ec', 'request_id': 'req-b693a20e-e430-4fbc-ab22-37253b87e68c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:06.658715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd02894e57eb4965bf27a76a98ba95ec', 'request_id': 'req-b693a20e-e430-4fbc-ab22-37253b87e68c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:06.669504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] The token cache is being invalidate because project bd02894e57eb4965bf27a76a98ba95ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:06.669786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:06.670462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b693a20e-e430-4fbc-ab22-37253b87e68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:06.672015 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1224/2429] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:06 2021] DELETE /identity/v3/projects/bd02894e57eb4965bf27a76a98ba95ec => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:06.677884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35290b-1114-4962-a432-ae00c470b63d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:06.678421 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35290b-1114-4962-a432-ae00c470b63d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:06.678518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35290b-1114-4962-a432-ae00c470b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:06.697235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9e35290b-1114-4962-a432-ae00c470b63d None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:06.698464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9e35290b-1114-4962-a432-ae00c470b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:06.755645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1206/2430] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:06.764626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9a15-141b-4a99-bdd7-0ef7b6a81ea3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:06.764935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9a15-141b-4a99-bdd7-0ef7b6a81ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:06.765222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9a15-141b-4a99-bdd7-0ef7b6a81ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:06.785093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c31e9a15-141b-4a99-bdd7-0ef7b6a81ea3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:06.786529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c31e9a15-141b-4a99-bdd7-0ef7b6a81ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:06.795537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1225/2431] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:06.805810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35290b-1114-4962-a432-ae00c470b63d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:06.816191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35290b-1114-4962-a432-ae00c470b63d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:06.820952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:06.821604 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:06.821897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:06.822468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:06.823266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:38:06.823582 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:06.825214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:06.840647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1207/2432] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:38:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:38:06.841780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e9a15-141b-4a99-bdd7-0ef7b6a81ea3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:06.850894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e9a15-141b-4a99-bdd7-0ef7b6a81ea3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:06.856136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:06.856790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:06.857074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:06.857353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:06.858067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:06.860073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:06.974213 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1226/2433] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:38:06 2021] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:06.977184 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:06.988169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35711e9-4a08-4f9f-8f93-a060ee88347d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:07.045923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:07.046599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:07.046918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:07.047196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:07.047931 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:07.049824 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:07.168112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1208/2434] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:38:06 2021] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:07.172224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:07.183110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111b9a-ee7d-479e-b4bc-9753125e2b72 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:07.188393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:07.189054 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:07.189337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:07.189759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:07.190548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:07.192144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:07.206057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1227/2435] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:07.215039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:07.226296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb6df-9ba1-43bc-a011-ec8ae041a206 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:07.231550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aeef59-4995-40f3-8e7f-b40970c253b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:07.232414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeef59-4995-40f3-8e7f-b40970c253b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:07.232697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeef59-4995-40f3-8e7f-b40970c253b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:07.232974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeef59-4995-40f3-8e7f-b40970c253b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:07.234113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeef59-4995-40f3-8e7f-b40970c253b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:07.235992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeef59-4995-40f3-8e7f-b40970c253b4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:07.250845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1209/2436] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:07 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:07.252415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:07.263279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a0c0b-24d1-4659-b5f4-f1d129527487 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:07.268387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:07.269430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:07.269581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:07.269866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] PATH_INFO: `/v3/projects/76c17d79aa3e434b8a66bfd4f0085b60/users/e70d95f907604c6bad74f5e5dbf3c74c/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:07.285740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c17d79aa3e434b8a66bfd4f0085b60, user_id=e70d95f907604c6bad74f5e5dbf3c74c, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:07.288417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:07.388469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1228/2437] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:38:07 2021] PUT /identity/v3/projects/76c17d79aa3e434b8a66bfd4f0085b60/users/e70d95f907604c6bad74f5e5dbf3c74c/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:07.394050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:07.394447 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:07.394718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:07.412222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:07.413414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:07.490144 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1210/2438] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:07.500796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:07.502703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:07.563642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876a1b-3e0c-41fe-aee9-6e4e9f6e62d2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:07.567595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd763-a938-4308-8026-0a96b0176416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:07.578963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd763-a938-4308-8026-0a96b0176416 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:07.578963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd763-a938-4308-8026-0a96b0176416 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:07.578963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd763-a938-4308-8026-0a96b0176416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:07.578963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd763-a938-4308-8026-0a96b0176416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:07.580335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd763-a938-4308-8026-0a96b0176416 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:07.591435 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1229/2439] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:11.207067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:11.215273 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:11.227962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077fb7b-c666-4da6-aaf8-fe3c85af13f7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:11.232339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:11.233153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:11.233532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:11.234062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:11.236190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:11.312413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:11.314888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:11.328786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1211/2440] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:11 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:14.604113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:14.605073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:14.606218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:14.646796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] MFA Rules not processed for user `e70d95f907604c6bad74f5e5dbf3c74c`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:14.648598 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:14.749519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1230/2441] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:14 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:14.753754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:14.771143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51507f-0722-47b4-8ef4-ed26441eebd4 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:14.776887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:14.778496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:14.778960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:14.779403 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:14.780335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:14.782522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:14.843223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:14.847045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:14.869098 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a25a3-2c23-4fa3-bd1c-1f84cb8eeb68 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:14.875650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:14.878141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:14.878541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:14.878894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] PATH_INFO: `/v3/users/f5e8703d480b4441a37487c96605b159` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:14.880404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e8703d480b4441a37487c96605b159)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:14.883782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:14.933404 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1212/2442] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:38:14 2021] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:14.937325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:15.031678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902460d-30d6-42d1-99c4-97846fd8ae1e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:15.036652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:15.037337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:15.037742 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:15.037984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:15.038804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:15.041120 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:15.149232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e8703d480b4441a37487c96605b159'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.161281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e8703d480b4441a37487c96605b159'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.171420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e8703d480b4441a37487c96605b159'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.171420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e8703d480b4441a37487c96605b159'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.174420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1213/2443] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:38:14 2021] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:38:15.177417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e8703d480b4441a37487c96605b159'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.178985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:15.181705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:15.201590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f666-77b3-4d49-bce4-fe1a8df9c5d5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:15.210068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:15.210068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:15.210068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:15.210413 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:15.211004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:15.212622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:15.223754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1214/2444] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:15.227957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:15.238836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba29dfb-85c1-4a8a-8677-4e0d390eca93 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:15.244244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:15.245222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:15.245513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:15.245790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] PATH_INFO: `/v3/projects/c9ed6c0e6d524e5eb66ddbf0d039f10e/users/ecdc61c2a0824e9b971d52744cae3ff9/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:15.263080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ed6c0e6d524e5eb66ddbf0d039f10e, user_id=ecdc61c2a0824e9b971d52744cae3ff9, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:15.267323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:15.270040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1231/2445] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:14 2021] DELETE /identity/v3/users/f5e8703d480b4441a37487c96605b159 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:38:15.382734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1215/2446] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:38:15 2021] PUT /identity/v3/projects/c9ed6c0e6d524e5eb66ddbf0d039f10e/users/ecdc61c2a0824e9b971d52744cae3ff9/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:15.385743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:15.458916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b1703-8c37-48a2-b06f-bbb53cd9624d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:15.518638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:15.523824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:15.523824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:15.523824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:15.523824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:15.523824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:15.531934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1232/2447] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:15 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:38:15.536060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:15.546668 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c4927-4699-4785-a962-30e35a4e1e4a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:15.551384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:15.552653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:15.553003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:15.553304 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] PATH_INFO: `/v3/projects/c9ed6c0e6d524e5eb66ddbf0d039f10e/users/ecdc61c2a0824e9b971d52744cae3ff9/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:15.555362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ed6c0e6d524e5eb66ddbf0d039f10e, user_id=ecdc61c2a0824e9b971d52744cae3ff9, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:15.557992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:15.571942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:15.576226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1216/2448] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:38:15 2021] PUT /identity/v3/projects/c9ed6c0e6d524e5eb66ddbf0d039f10e/users/ecdc61c2a0824e9b971d52744cae3ff9/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:15.579385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:15.597687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e11a5-21aa-4733-92f6-365fe8a27973 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:15.655045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:15.655899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:15.656177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:15.656448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] PATH_INFO: `/v3/projects/ca6098612cf34bd49106135584f66f8b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:15.657638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6098612cf34bd49106135584f66f8b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:15.659558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:15.787072 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6098612cf34bd49106135584f66f8b', 'request_id': 'req-62e2d639-b562-4e32-88c6-5bd1eb73d6be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.794383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6098612cf34bd49106135584f66f8b', 'request_id': 'req-62e2d639-b562-4e32-88c6-5bd1eb73d6be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.885734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6098612cf34bd49106135584f66f8b', 'request_id': 'req-62e2d639-b562-4e32-88c6-5bd1eb73d6be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.917503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] The token cache is being invalidate because project ca6098612cf34bd49106135584f66f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:15.917807 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.919356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:15.924384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1233/2449] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:15 2021] DELETE /identity/v3/projects/ca6098612cf34bd49106135584f66f8b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:38:15.925887 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:15.927789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:15.945346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a37d-e107-455e-b140-9ed2baa8fc64 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:16.001760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:16.003132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:16.003442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:16.003708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] PATH_INFO: `/v3/users/64d4f7b812dd444d90cfcbbbc3f304d9` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:16.004946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d4f7b812dd444d90cfcbbbc3f304d9)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:16.006926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:16.238866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d4f7b812dd444d90cfcbbbc3f304d9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:16.239528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d4f7b812dd444d90cfcbbbc3f304d9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:16.251762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d4f7b812dd444d90cfcbbbc3f304d9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:16.252478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d4f7b812dd444d90cfcbbbc3f304d9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:16.325768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69218420-07cb-41c7-b9b9-0173b550d78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d4f7b812dd444d90cfcbbbc3f304d9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:16.340786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1217/2450] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:15 2021] DELETE /identity/v3/users/64d4f7b812dd444d90cfcbbbc3f304d9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:38:16.651362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:16.677390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d639-b562-4e32-88c6-5bd1eb73d6be admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:16.784449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:16.785394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:16.785680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:16.786065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] PATH_INFO: `/v3/projects/120eee556e324b848e26cef484b3862a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:16.787805 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120eee556e324b848e26cef484b3862a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:16.790201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:16.921401 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120eee556e324b848e26cef484b3862a', 'request_id': 'req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:16.927945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120eee556e324b848e26cef484b3862a', 'request_id': 'req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:17.033540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120eee556e324b848e26cef484b3862a', 'request_id': 'req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:17.068147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] The token cache is being invalidate because project 120eee556e324b848e26cef484b3862a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:17.070714 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:17.071541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2039fef3-424e-44f7-8fbc-d1dd1a3b3190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:17.078995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1234/2451] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:16 2021] DELETE /identity/v3/projects/120eee556e324b848e26cef484b3862a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:17.080526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e844-980c-4778-962a-06c4b55c72e9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.080977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e844-980c-4778-962a-06c4b55c72e9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.087866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e844-980c-4778-962a-06c4b55c72e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.108997 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0fe2e844-980c-4778-962a-06c4b55c72e9 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:17.110248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0fe2e844-980c-4778-962a-06c4b55c72e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:17.206937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1218/2452] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:17.208909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947224-f11f-4a8c-b996-e5b1497cd0df None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.209434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947224-f11f-4a8c-b996-e5b1497cd0df None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.209922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42947224-f11f-4a8c-b996-e5b1497cd0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.235839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-42947224-f11f-4a8c-b996-e5b1497cd0df None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:17.235839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-42947224-f11f-4a8c-b996-e5b1497cd0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:17.240373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1235/2453] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:17.244906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e844-980c-4778-962a-06c4b55c72e9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:17.255182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e844-980c-4778-962a-06c4b55c72e9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:17.261009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:17.262314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.262856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.263402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.264322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:38:17.264630 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:17.266383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:17.280062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1219/2454] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:38:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:38:17.284569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42947224-f11f-4a8c-b996-e5b1497cd0df None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:17.300811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42947224-f11f-4a8c-b996-e5b1497cd0df None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:17.308630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:17.309446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.309745 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.310172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.311050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:17.313075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:17.422764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1236/2455] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:38:17 2021] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:17.426495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:17.438111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21ab9-79c0-4cf4-931c-5838984f1a13 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:17.515243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:17.516143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.517015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.517015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.517951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:17.519991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:17.657149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1220/2456] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:38:17 2021] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:38:17.661127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:17.671663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52910087-1162-480d-b9f6-eba647322722 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:17.684212 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:17.685295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.687120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.687120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.687120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:17.689617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:17.707063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1237/2457] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:17 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:17.711666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:17.725942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd37c-fa3a-4230-b4a1-b96190593989 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:17.733761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee0154-45a5-49c5-9702-968a1c229453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:17.734815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0154-45a5-49c5-9702-968a1c229453 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.735303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0154-45a5-49c5-9702-968a1c229453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.735844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee0154-45a5-49c5-9702-968a1c229453 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.736858 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee0154-45a5-49c5-9702-968a1c229453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:17.739238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee0154-45a5-49c5-9702-968a1c229453 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:17.760605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1221/2458] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:17 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:17.766594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:17.775498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd9d80-70b7-4bb4-80d6-ff3bcbd81172 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:17.782824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:17.784125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.784600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.785061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] PATH_INFO: `/v3/projects/d1717eee45cc45a6a5b4e84b629c1b38/users/b1ecf7e9f8084c17a0ec0169cc47ff8d/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.803167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1717eee45cc45a6a5b4e84b629c1b38, user_id=b1ecf7e9f8084c17a0ec0169cc47ff8d, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:17.806583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:17.892119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1238/2459] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:38:17 2021] PUT /identity/v3/projects/d1717eee45cc45a6a5b4e84b629c1b38/users/b1ecf7e9f8084c17a0ec0169cc47ff8d/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:38:17.894427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a933431-c5c2-4e8c-9caf-b18dfbd81db0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:17.895508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a933431-c5c2-4e8c-9caf-b18dfbd81db0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:17.896044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a933431-c5c2-4e8c-9caf-b18dfbd81db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:17.935391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7a933431-c5c2-4e8c-9caf-b18dfbd81db0 None None] MFA Rules not processed for user `b1ecf7e9f8084c17a0ec0169cc47ff8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:17.937186 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7a933431-c5c2-4e8c-9caf-b18dfbd81db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:18.027196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1222/2460] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:18.042842 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:18.045823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:18.130266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cbcee-c1c6-4920-ac23-82099d6fd060 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:18.140696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906118d7-4c1e-431e-9ef2-b054026f5730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:18.141180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906118d7-4c1e-431e-9ef2-b054026f5730 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:18.141467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906118d7-4c1e-431e-9ef2-b054026f5730 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:18.142005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906118d7-4c1e-431e-9ef2-b054026f5730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:18.163674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906118d7-4c1e-431e-9ef2-b054026f5730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:18.165279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906118d7-4c1e-431e-9ef2-b054026f5730 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:18.188978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1239/2461] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:18 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:18.217713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a933431-c5c2-4e8c-9caf-b18dfbd81db0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:18.301384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a933431-c5c2-4e8c-9caf-b18dfbd81db0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:18.306128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:18.306968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:18.307255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:18.307527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] PATH_INFO: `/v3/users/b1ecf7e9f8084c17a0ec0169cc47ff8d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:18.309420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ecf7e9f8084c17a0ec0169cc47ff8d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:18.311478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:18.559548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ecf7e9f8084c17a0ec0169cc47ff8d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:18.560224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ecf7e9f8084c17a0ec0169cc47ff8d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:18.573424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ecf7e9f8084c17a0ec0169cc47ff8d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:18.574444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ecf7e9f8084c17a0ec0169cc47ff8d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:18.665590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ecf7e9f8084c17a0ec0169cc47ff8d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:18.687491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1223/2462] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:18 2021] DELETE /identity/v3/users/b1ecf7e9f8084c17a0ec0169cc47ff8d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:18.696313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:18.697426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:18.697956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:18.726516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:18.727753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:18.808113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1240/2463] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:18.818252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:18.819737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:18.898102 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9dfde-209b-4c42-a059-777b92d03409 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:18.904327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc2359-f8dd-448f-a0b1-f908d006c797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:18.905290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2359-f8dd-448f-a0b1-f908d006c797 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:18.905577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2359-f8dd-448f-a0b1-f908d006c797 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:18.905852 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2359-f8dd-448f-a0b1-f908d006c797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:18.924116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc2359-f8dd-448f-a0b1-f908d006c797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:18.925873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc2359-f8dd-448f-a0b1-f908d006c797 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:18.939258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1224/2464] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:19.495469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:19.495469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:19.514470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552c63-7850-4253-8d7a-9038e06f1514 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:19.519860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:19.521518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:19.521983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:19.524543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] PATH_INFO: `/v3/projects/d1717eee45cc45a6a5b4e84b629c1b38` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:19.524543 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1717eee45cc45a6a5b4e84b629c1b38)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:19.526377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:19.670052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1717eee45cc45a6a5b4e84b629c1b38', 'request_id': 'req-767285a6-9bdd-4740-bea1-c28b6982b6cb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:19.680040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1717eee45cc45a6a5b4e84b629c1b38', 'request_id': 'req-767285a6-9bdd-4740-bea1-c28b6982b6cb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:19.776122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1717eee45cc45a6a5b4e84b629c1b38', 'request_id': 'req-767285a6-9bdd-4740-bea1-c28b6982b6cb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:19.790032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] The token cache is being invalidate because project d1717eee45cc45a6a5b4e84b629c1b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:19.790927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:19.799998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-767285a6-9bdd-4740-bea1-c28b6982b6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:19.803034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1241/2465] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:19 2021] DELETE /identity/v3/projects/d1717eee45cc45a6a5b4e84b629c1b38 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:19.810920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcf531-6197-4680-806e-8606db744d79 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:19.811916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcf531-6197-4680-806e-8606db744d79 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:19.812424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcf531-6197-4680-806e-8606db744d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:19.838871 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-46dcf531-6197-4680-806e-8606db744d79 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:19.840242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-46dcf531-6197-4680-806e-8606db744d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:19.929702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1225/2466] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:19.938558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d12b-c7e5-4a13-b728-18db52f9d0ce None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:19.939125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d12b-c7e5-4a13-b728-18db52f9d0ce None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:19.939608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d12b-c7e5-4a13-b728-18db52f9d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:19.964383 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0791d12b-c7e5-4a13-b728-18db52f9d0ce None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:19.966541 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0791d12b-c7e5-4a13-b728-18db52f9d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:19.976425 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1242/2467] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:19.981131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcf531-6197-4680-806e-8606db744d79 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:19.992848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcf531-6197-4680-806e-8606db744d79 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:19.999476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.000168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.000449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.000725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.001861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:38:20.002640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.005358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:20.020710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1226/2468] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:38:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:38:20.026129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791d12b-c7e5-4a13-b728-18db52f9d0ce None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:20.035293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791d12b-c7e5-4a13-b728-18db52f9d0ce None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:20.040227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.040908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.041194 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.041473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.042232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.044870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:20.144623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1243/2469] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:38:20 2021] POST /identity/v3/projects => generated 359 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:20.149201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:20.162314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc972-047d-4b4e-aeab-9d216d69c04c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:20.232202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.232886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.233165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.233592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.234342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.236309 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:20.298405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1227/2470] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:38:20 2021] POST /identity/v3/users => generated 280 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:20.302470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:20.316226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e32f5c-0ac9-4f6b-97fc-f7cb7144cdef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:20.321516 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.322296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.322658 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.323040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.324001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.326338 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:20.343879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1244/2471] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:20.345814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:20.357507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb438875-2a00-45ba-9bf0-222f597364db admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:20.363985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d04df6-1019-48f0-b934-8f9891af34dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.364967 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d04df6-1019-48f0-b934-8f9891af34dd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.365449 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d04df6-1019-48f0-b934-8f9891af34dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.366280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d04df6-1019-48f0-b934-8f9891af34dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.367515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d04df6-1019-48f0-b934-8f9891af34dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.370268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d04df6-1019-48f0-b934-8f9891af34dd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:20.386556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1228/2472] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:20.388417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:20.401897 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa8330-d6db-48fa-b44e-1eb2995125c2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:20.409573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.411801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.412118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.412910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] PATH_INFO: `/v3/projects/5dc88f5c55c642f3abc5e847331ff6b9/users/692dd9fdb90549b4a6c92fdeee7cf44d/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.432512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc88f5c55c642f3abc5e847331ff6b9, user_id=692dd9fdb90549b4a6c92fdeee7cf44d, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.436473 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:20.554144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1245/2473] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:38:20 2021] PUT /identity/v3/projects/5dc88f5c55c642f3abc5e847331ff6b9/users/692dd9fdb90549b4a6c92fdeee7cf44d/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:38:20.565591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2360d-da5e-4811-b09e-fa199c8e4297 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.566232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2360d-da5e-4811-b09e-fa199c8e4297 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.566596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2360d-da5e-4811-b09e-fa199c8e4297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.596356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0dd2360d-da5e-4811-b09e-fa199c8e4297 None None] MFA Rules not processed for user `692dd9fdb90549b4a6c92fdeee7cf44d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:20.597624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0dd2360d-da5e-4811-b09e-fa199c8e4297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:20.674999 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1229/2474] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:20 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:20.714084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:20.718498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:20.810162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806cbe-48a5-49f2-b9c0-b94278d3e569 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:20.816470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ace3e3-a8dd-434f-b8f0-2258593f5e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.817553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ace3e3-a8dd-434f-b8f0-2258593f5e50 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.818113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ace3e3-a8dd-434f-b8f0-2258593f5e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.818611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ace3e3-a8dd-434f-b8f0-2258593f5e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.829839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ace3e3-a8dd-434f-b8f0-2258593f5e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.833139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ace3e3-a8dd-434f-b8f0-2258593f5e50 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:20.845319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1246/2475] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:20 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:20.860381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2360d-da5e-4811-b09e-fa199c8e4297 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:20.931155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2360d-da5e-4811-b09e-fa199c8e4297 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:20.938528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:20.938528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:20.938528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:20.938528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] PATH_INFO: `/v3/users/692dd9fdb90549b4a6c92fdeee7cf44d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:20.938912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692dd9fdb90549b4a6c92fdeee7cf44d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:20.940727 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:21.210686 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692dd9fdb90549b4a6c92fdeee7cf44d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:21.211360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692dd9fdb90549b4a6c92fdeee7cf44d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:21.225243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692dd9fdb90549b4a6c92fdeee7cf44d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:21.233399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692dd9fdb90549b4a6c92fdeee7cf44d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:21.310810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692dd9fdb90549b4a6c92fdeee7cf44d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:21.327511 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1230/2476] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:20 2021] DELETE /identity/v3/users/692dd9fdb90549b4a6c92fdeee7cf44d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:21.331924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912404c6-fa67-439f-af08-789579187487 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:21.332216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912404c6-fa67-439f-af08-789579187487 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:21.332491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912404c6-fa67-439f-af08-789579187487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:21.350720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-912404c6-fa67-439f-af08-789579187487 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:21.352036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-912404c6-fa67-439f-af08-789579187487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:21.422157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1247/2477] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:21.428656 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:21.430261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:21.539535 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695d006-5682-47d0-a686-b03da4e7dcf2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:21.544828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:21.545492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:21.545775 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:21.546054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:21.559771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:21.561181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:21.586763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1231/2478] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:21.736150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:21.736446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:21.736722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:21.765891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] MFA Rules not processed for user `ecdc61c2a0824e9b971d52744cae3ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:21.767530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:21.847261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1248/2479] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:21 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:21.861521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:21.862960 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:21.933293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f9745-9c21-4edb-8ec8-d57166af0a92 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:21.938547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be4eb5-d548-4ede-8d75-b68f60edcf9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:21.939207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4eb5-d548-4ede-8d75-b68f60edcf9e service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:21.939491 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4eb5-d548-4ede-8d75-b68f60edcf9e service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:21.939774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4eb5-d548-4ede-8d75-b68f60edcf9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:21.941884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e5be4eb5-d548-4ede-8d75-b68f60edcf9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:22.010550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be4eb5-d548-4ede-8d75-b68f60edcf9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:22.012046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be4eb5-d548-4ede-8d75-b68f60edcf9e service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:22.022085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1232/2480] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:21 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:22.110431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:22.111795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:22.128554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e0c95-9899-46ac-9f22-9bd85e53a9ae None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:22.133283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:22.134143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.134452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.134728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] PATH_INFO: `/v3/projects/5dc88f5c55c642f3abc5e847331ff6b9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.136073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc88f5c55c642f3abc5e847331ff6b9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:22.138427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:22.297406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc88f5c55c642f3abc5e847331ff6b9', 'request_id': 'req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:22.303653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc88f5c55c642f3abc5e847331ff6b9', 'request_id': 'req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:22.358622 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd010-ad58-4a9a-b74b-755becc674f9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.358933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd010-ad58-4a9a-b74b-755becc674f9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.359254 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd010-ad58-4a9a-b74b-755becc674f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.377118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-823dd010-ad58-4a9a-b74b-755becc674f9 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:22.378383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-823dd010-ad58-4a9a-b74b-755becc674f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:22.398970 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc88f5c55c642f3abc5e847331ff6b9', 'request_id': 'req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:22.411156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] The token cache is being invalidate because project 5dc88f5c55c642f3abc5e847331ff6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:22.411443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:22.412081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48ded029-bc1a-434b-ac9f-4caf2b19fe5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:22.413646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1249/2481] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:22 2021] DELETE /identity/v3/projects/5dc88f5c55c642f3abc5e847331ff6b9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:22.420073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83450c3-9c57-4a53-a526-de664bf5d802 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.420760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83450c3-9c57-4a53-a526-de664bf5d802 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.421065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83450c3-9c57-4a53-a526-de664bf5d802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.438252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1233/2482] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:38:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:22.441545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e83450c3-9c57-4a53-a526-de664bf5d802 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:22.442859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e83450c3-9c57-4a53-a526-de664bf5d802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:22.504898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1250/2483] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:22.512812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.513109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.513420 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.533294 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:22.534786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:22.544210 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1234/2484] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:22.550780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83450c3-9c57-4a53-a526-de664bf5d802 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:22.560524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83450c3-9c57-4a53-a526-de664bf5d802 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:22.565404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:22.566088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.566411 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.566691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.567448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:38:22.567791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:22.569405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:22.578353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:22.579717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:22.585265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1251/2485] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:38:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:38:22.586114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:22.596906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649f75-5cdd-4056-8169-0f2a9de36968 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:22.602215 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:22.602508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.602783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.603094 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.603916 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:22.606093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:22.673708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1270e-189d-4257-9760-981c4a65808f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:22.685527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:22.686364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.686789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.687196 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.698325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:22.701469 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:22.705831 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1252/2486] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:38:22 2021] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:38:22.707696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:22.711400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1235/2487] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:38:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:38:22.811082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92fa7a-5654-409c-a78b-04c0efd318eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:22.822593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:22.823490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.823782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.824059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.825310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:22.827405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:22.928125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1253/2488] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:38:22 2021] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:22.928996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:22.946161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dd4bd-387b-46aa-a8a4-f1393ae8d4b3 service swift] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:22.965035 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:22.966328 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:22.966789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:22.967225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:22.967985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:22.969697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:22.994124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:22.995150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1236/2489] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:22 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:38:23.007763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bacf6-9bc5-4fc6-bbd1-1f96b3d9bde0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:23.020439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab0983-9e54-4b5d-84ae-5595ce8b64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:23.021127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab0983-9e54-4b5d-84ae-5595ce8b64d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:23.021409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab0983-9e54-4b5d-84ae-5595ce8b64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:23.021688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab0983-9e54-4b5d-84ae-5595ce8b64d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:23.022468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab0983-9e54-4b5d-84ae-5595ce8b64d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:23.024231 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab0983-9e54-4b5d-84ae-5595ce8b64d3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:23.051415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:23.051834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1254/2490] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:22 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:38:23.064684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c59d0-2d2b-4614-8f96-44730d7d6dc6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:23.071157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:23.072047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:23.072324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:23.072599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] PATH_INFO: `/v3/projects/5e979936003b4bd5beb572f7c57982f8/users/a42631ba6c994ba29c92f49044a6ce69/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:23.102660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e979936003b4bd5beb572f7c57982f8, user_id=a42631ba6c994ba29c92f49044a6ce69, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:23.110054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:23.273311 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1237/2491] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:38:23 2021] PUT /identity/v3/projects/5e979936003b4bd5beb572f7c57982f8/users/a42631ba6c994ba29c92f49044a6ce69/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:23.286437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f66cf-b669-4527-84e6-8f3454d88271 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:23.286782 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f66cf-b669-4527-84e6-8f3454d88271 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:23.287068 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f66cf-b669-4527-84e6-8f3454d88271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:23.348618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-855f66cf-b669-4527-84e6-8f3454d88271 None None] MFA Rules not processed for user `a42631ba6c994ba29c92f49044a6ce69`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:23.349925 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-855f66cf-b669-4527-84e6-8f3454d88271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:23.432518 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1255/2492] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:23 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:23.445109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:23.446878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:23.517233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76816da-ab33-41a0-afc4-c12b78fb0cda admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:23.521092 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fbf85-0624-4691-a815-155548146cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:23.521737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbf85-0624-4691-a815-155548146cbc service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:23.522018 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbf85-0624-4691-a815-155548146cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:23.523085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fbf85-0624-4691-a815-155548146cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:23.534784 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fbf85-0624-4691-a815-155548146cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:23.536291 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fbf85-0624-4691-a815-155548146cbc service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:23.547225 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1238/2493] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:23 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:28.208113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f66cf-b669-4527-84e6-8f3454d88271 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:28.284201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f66cf-b669-4527-84e6-8f3454d88271 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:28.289307 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:28.290255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:28.290545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:28.290826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] PATH_INFO: `/v3/users/a42631ba6c994ba29c92f49044a6ce69` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:28.292061 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42631ba6c994ba29c92f49044a6ce69)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:28.295320 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:28.518147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42631ba6c994ba29c92f49044a6ce69'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:28.536408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42631ba6c994ba29c92f49044a6ce69'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:28.536408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42631ba6c994ba29c92f49044a6ce69'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:28.536408 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42631ba6c994ba29c92f49044a6ce69'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:28.550377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42631ba6c994ba29c92f49044a6ce69'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:28.635663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1256/2494] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:28 2021] DELETE /identity/v3/users/a42631ba6c994ba29c92f49044a6ce69 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:28.641212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:28.642005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:28.642005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:28.664090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:28.665290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:28.735104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1239/2495] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:28.744684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:28.746759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:28.813814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36867ebd-65f9-4cde-a5f8-194a5d3f56c3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:28.823871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d8db3-5b5d-43b9-bc87-8f8c4a13b806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:28.825143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d8db3-5b5d-43b9-bc87-8f8c4a13b806 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:28.825570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d8db3-5b5d-43b9-bc87-8f8c4a13b806 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:28.825846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d8db3-5b5d-43b9-bc87-8f8c4a13b806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:28.835709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d8db3-5b5d-43b9-bc87-8f8c4a13b806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:28.837156 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d8db3-5b5d-43b9-bc87-8f8c4a13b806 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:28.848404 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1257/2496] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:29.495384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:29.497545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:29.514765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ea13-3c81-49ab-8e94-c128df16f11a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:29.518616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:29.519483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:29.519763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:29.520171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] PATH_INFO: `/v3/projects/5e979936003b4bd5beb572f7c57982f8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:29.521494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e979936003b4bd5beb572f7c57982f8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:29.523410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:29.702886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e979936003b4bd5beb572f7c57982f8', 'request_id': 'req-547a3c0e-797d-4cd1-b2ed-cb9097efb917'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:29.708041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e979936003b4bd5beb572f7c57982f8', 'request_id': 'req-547a3c0e-797d-4cd1-b2ed-cb9097efb917'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:29.770751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e979936003b4bd5beb572f7c57982f8', 'request_id': 'req-547a3c0e-797d-4cd1-b2ed-cb9097efb917'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:29.784690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] The token cache is being invalidate because project 5e979936003b4bd5beb572f7c57982f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:29.784982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:29.785636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-547a3c0e-797d-4cd1-b2ed-cb9097efb917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:29.787206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1240/2497] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:29 2021] DELETE /identity/v3/projects/5e979936003b4bd5beb572f7c57982f8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:29.795058 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d5cc-7d82-4e3b-9ed4-66001e4c1119 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:29.795525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d5cc-7d82-4e3b-9ed4-66001e4c1119 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:29.795617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d5cc-7d82-4e3b-9ed4-66001e4c1119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:29.814604 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-39b7d5cc-7d82-4e3b-9ed4-66001e4c1119 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:29.815847 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-39b7d5cc-7d82-4e3b-9ed4-66001e4c1119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:29.886046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1258/2498] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:29.895070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96ef2-4bc3-40ce-8cfd-0ee0477ed42a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:29.895754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96ef2-4bc3-40ce-8cfd-0ee0477ed42a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:29.896274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96ef2-4bc3-40ce-8cfd-0ee0477ed42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:29.921324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2ee96ef2-4bc3-40ce-8cfd-0ee0477ed42a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:29.922959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2ee96ef2-4bc3-40ce-8cfd-0ee0477ed42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:29.934873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1241/2499] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:29.939080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d5cc-7d82-4e3b-9ed4-66001e4c1119 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:29.949998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d5cc-7d82-4e3b-9ed4-66001e4c1119 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:29.955023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:29.955698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:29.956057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:29.956509 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:29.959308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:38:29.959308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:29.959989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:29.976489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1259/2500] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:38:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:38:29.980107 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee96ef2-4bc3-40ce-8cfd-0ee0477ed42a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:29.990125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee96ef2-4bc3-40ce-8cfd-0ee0477ed42a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:29.995326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:29.996109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:29.996436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:29.996798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:29.997625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:30.001749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:30.118447 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1242/2501] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:38:29 2021] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:30.119600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:30.131570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a947-580b-4639-9723-87c0f70cc816 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:30.209004 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:30.209734 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:30.210027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:30.210367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:30.211075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:30.213079 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:30.317966 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1260/2502] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:38:30 2021] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:38:30.319830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:30.333814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24257e4b-f2c0-4858-af3a-3160ffd95733 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:30.339391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:30.340716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:30.341242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:30.342023 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:30.342718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:30.344366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:30.360378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1243/2503] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:38:30.361683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:30.374572 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25f8a-6aba-4bfa-9c01-281d87445940 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:30.379330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e94d-52af-4a0f-8f95-dc0f0e347097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:30.379990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e94d-52af-4a0f-8f95-dc0f0e347097 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:30.380271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e94d-52af-4a0f-8f95-dc0f0e347097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:30.380545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e94d-52af-4a0f-8f95-dc0f0e347097 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:30.381289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e94d-52af-4a0f-8f95-dc0f0e347097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:30.382902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e94d-52af-4a0f-8f95-dc0f0e347097 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:30.399256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1261/2504] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:38:30 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:38:30.400392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:30.412005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742426f-788a-4b40-909d-0e0a9134cf48 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:30.416569 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:30.417501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:30.417786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:30.418811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] PATH_INFO: `/v3/projects/18c3543a14a5460fb7e6c124fab43b0c/users/df7391330c3145cdb6acb1786cd17aa8/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:30.436333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c3543a14a5460fb7e6c124fab43b0c, user_id=df7391330c3145cdb6acb1786cd17aa8, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:30.439173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:30.569801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1244/2505] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:38:30 2021] PUT /identity/v3/projects/18c3543a14a5460fb7e6c124fab43b0c/users/df7391330c3145cdb6acb1786cd17aa8/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:30.570983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e715f6-1ae9-4dc4-8c50-68c869edcd0a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:30.571270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e715f6-1ae9-4dc4-8c50-68c869edcd0a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:30.571553 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e715f6-1ae9-4dc4-8c50-68c869edcd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:30.607682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-28e715f6-1ae9-4dc4-8c50-68c869edcd0a None None] MFA Rules not processed for user `df7391330c3145cdb6acb1786cd17aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:30.609253 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-28e715f6-1ae9-4dc4-8c50-68c869edcd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:30.687433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1262/2506] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:30 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:30.697395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:30.699508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:30.764047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ef578-3f68-4ed2-ae89-e441e29e452c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:30.770259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa74ecf-7550-43a5-aa7f-653d2c30eb52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:30.770923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa74ecf-7550-43a5-aa7f-653d2c30eb52 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:30.771231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa74ecf-7550-43a5-aa7f-653d2c30eb52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:30.771494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa74ecf-7550-43a5-aa7f-653d2c30eb52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:30.781968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa74ecf-7550-43a5-aa7f-653d2c30eb52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:30.783550 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa74ecf-7550-43a5-aa7f-653d2c30eb52 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:30.793933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1245/2507] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:30 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:30.825419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e715f6-1ae9-4dc4-8c50-68c869edcd0a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:30.900017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e715f6-1ae9-4dc4-8c50-68c869edcd0a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:30.905206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:30.906110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:30.906429 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:30.906711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] PATH_INFO: `/v3/users/df7391330c3145cdb6acb1786cd17aa8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:30.907963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7391330c3145cdb6acb1786cd17aa8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:30.909919 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:31.106060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7391330c3145cdb6acb1786cd17aa8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:31.123503 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7391330c3145cdb6acb1786cd17aa8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:31.124635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7391330c3145cdb6acb1786cd17aa8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:31.125313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7391330c3145cdb6acb1786cd17aa8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:31.136684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7391330c3145cdb6acb1786cd17aa8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:31.219934 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1263/2508] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:38:30 2021] DELETE /identity/v3/users/df7391330c3145cdb6acb1786cd17aa8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:31.224298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:31.224658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:31.224944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:31.247542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:31.248762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:31.326534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1246/2509] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:38:31.336851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:31.338558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:31.404735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59746472-6587-43be-b9a4-5e4854db1d44 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:31.410932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19010a25-3673-4d6d-9edb-956fda12a232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:31.411718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010a25-3673-4d6d-9edb-956fda12a232 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:31.412002 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010a25-3673-4d6d-9edb-956fda12a232 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:31.412275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19010a25-3673-4d6d-9edb-956fda12a232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:31.423041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19010a25-3673-4d6d-9edb-956fda12a232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:31.424475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19010a25-3673-4d6d-9edb-956fda12a232 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:31.437355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1264/2510] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:31.934904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:31.936598 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:31.952695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64c7e7-1d26-40b5-ae6c-9c320e1ef90c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:31.962890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:31.963897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:31.964282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:31.964689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] PATH_INFO: `/v3/projects/18c3543a14a5460fb7e6c124fab43b0c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:31.966167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c3543a14a5460fb7e6c124fab43b0c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:31.968408 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:32.219771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c3543a14a5460fb7e6c124fab43b0c', 'request_id': 'req-71609053-1ca7-4478-97fc-1876c4fed673'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:32.225153 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c3543a14a5460fb7e6c124fab43b0c', 'request_id': 'req-71609053-1ca7-4478-97fc-1876c4fed673'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:32.302131 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c3543a14a5460fb7e6c124fab43b0c', 'request_id': 'req-71609053-1ca7-4478-97fc-1876c4fed673'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:32.314909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] The token cache is being invalidate because project 18c3543a14a5460fb7e6c124fab43b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:38:32.316188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:32.316188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:38:32.317607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1247/2511] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:38:31 2021] DELETE /identity/v3/projects/18c3543a14a5460fb7e6c124fab43b0c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:38:34.538827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb820-bd3c-470c-883c-150378ac1ad4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:34.539189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb820-bd3c-470c-883c-150378ac1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:34.539278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb820-bd3c-470c-883c-150378ac1ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:34.556991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c2bcb820-bd3c-470c-883c-150378ac1ad4 None None] MFA Rules not processed for user `e70d95f907604c6bad74f5e5dbf3c74c`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:34.558197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c2bcb820-bd3c-470c-883c-150378ac1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:34.611552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1265/2512] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:38:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:37.451531 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:37.452950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:37.510919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71609053-1ca7-4478-97fc-1876c4fed673 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:37.515448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:37.516095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:37.516380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:37.516662 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:37.518734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:37.589700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:37.591940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:37.602637 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1248/2513] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:38.338581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:38.339037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:38.339180 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:38.358402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:38:38.359620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:38.416519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1266/2514] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:38:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:38:38.429900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:38.431393 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:38.499472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7bac8-d1bb-4f1d-8055-41f1280ef3bc service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:38.504566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:38.505212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:38.505495 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:38.505769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:38.514003 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:38.515645 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:38.524343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1249/2515] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:38:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:38:38.712164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:38.713577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:38.725497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0097-fefd-4378-9550-0409e951814d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:38.729962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:38.730654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:38.730939 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:38.731792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:38.733877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:38.754896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:38.756586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:38.775066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1267/2516] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:52.277838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:52.284730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2acc4-7e34-4041-b8b6-1a4dff247611 service swift] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:52.288438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:52.289083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:52.289364 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:52.289666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:52.291568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:52.303882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:52.305537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:52.316643 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1250/2517] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:52 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:38:54.354924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:54.356406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:54.410248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ca9fd-7a90-415a-8e52-64dcc5ac8cf0 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:54.413823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdfc8d-f0ec-4077-8ae6-14706e366300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:54.414489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc8d-f0ec-4077-8ae6-14706e366300 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:54.414784 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc8d-f0ec-4077-8ae6-14706e366300 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:54.415063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdfc8d-f0ec-4077-8ae6-14706e366300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:54.416806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f9bdfc8d-f0ec-4077-8ae6-14706e366300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:54.475221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdfc8d-f0ec-4077-8ae6-14706e366300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:54.476667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdfc8d-f0ec-4077-8ae6-14706e366300 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:54.486119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1268/2518] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:54 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:38:58.384173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:38:58.385652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:58.403703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20c177-06ab-48e9-8e05-2d4f58995303 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:38:58.410208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:38:58.410867 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:38:58.411154 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:38:58.411433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:38:58.413208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:38:58.425934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:38:58.427683 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:38:58.439632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1251/2519] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:38:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:39:03.363495 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:03.364038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:03.364165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:03.381811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] MFA Rules not processed for user `c0e12bd4237643e99e03e73f6c5c69f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:39:03.383036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:03.389822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1269/2520] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:39:03 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:39:03.698669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:03.708101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e1765-b831-454d-842d-f0cc006b8875 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:03.711717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8670e1-a0c6-4030-8f60-df3bcc639b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:03.712344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8670e1-a0c6-4030-8f60-df3bcc639b5d service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:03.712626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8670e1-a0c6-4030-8f60-df3bcc639b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:03.712933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8670e1-a0c6-4030-8f60-df3bcc639b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:03.714717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fa8670e1-a0c6-4030-8f60-df3bcc639b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:03.725078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8670e1-a0c6-4030-8f60-df3bcc639b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:03.726539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8670e1-a0c6-4030-8f60-df3bcc639b5d service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:03.735445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1252/2521] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:39:04.188674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:04.190955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:04.267254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb78ee-4522-4b3f-9742-11ac6da143c1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:04.273026 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a0c26778994b0c93541400cde47bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:04.273287 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:04.273577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:04.273893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:04.275836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:04.287834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:04.289405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:04.299488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1270/2522] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:39:09.384512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42974-4695-438c-821d-b348362e9349 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:09.384968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42974-4695-438c-821d-b348362e9349 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:09.385062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42974-4695-438c-821d-b348362e9349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:09.403035 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-73c42974-4695-438c-821d-b348362e9349 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:39:09.404226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-73c42974-4695-438c-821d-b348362e9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:09.412999 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1253/2523] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:39:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:39:09.425815 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:09.437569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a99bf-650b-4823-b07b-d4335ee5e367 service placement] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:09.442701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:09.443368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:09.443654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:09.443931 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:09.451911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:09.454355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:09.462529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1271/2524] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:39:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:39:12.755671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c42974-4695-438c-821d-b348362e9349 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:12.765514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c42974-4695-438c-821d-b348362e9349 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:12.770330 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:12.780466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:12.782538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:12.783067 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:12.786926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:12.872407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:12.873886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:12.885623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1254/2525] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:12 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:39:13.848869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:13.868468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feb146-de4c-4964-b358-c21ccf1efe91 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:13.876924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:13.877994 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:13.878299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:13.878768 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:13.880753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:13.894909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:13.896763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:13.909384 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1272/2526] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:39:15.606634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:15.635229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc139a-763c-49a9-9c7a-a5f409f23ff6 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:15.635229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6553d78-f87d-4657-8160-655d5a9a8404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:15.635229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6553d78-f87d-4657-8160-655d5a9a8404 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:15.635229 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6553d78-f87d-4657-8160-655d5a9a8404 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:15.635601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6553d78-f87d-4657-8160-655d5a9a8404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:15.635601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a6553d78-f87d-4657-8160-655d5a9a8404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:15.663621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6553d78-f87d-4657-8160-655d5a9a8404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:15.666758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6553d78-f87d-4657-8160-655d5a9a8404 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:15.682213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1255/2527] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:39:26.570935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:26.580667 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91596b3-ba97-41b5-a750-bda20279cca9 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:26.586356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5f4aa-b2e5-49c9-89f9-e8c9203a5aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:26.586356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4aa-b2e5-49c9-89f9-e8c9203a5aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:26.586356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4aa-b2e5-49c9-89f9-e8c9203a5aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:26.586356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5f4aa-b2e5-49c9-89f9-e8c9203a5aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:26.596724 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-53a5f4aa-b2e5-49c9-89f9-e8c9203a5aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:26.606608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5f4aa-b2e5-49c9-89f9-e8c9203a5aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:26.608031 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5f4aa-b2e5-49c9-89f9-e8c9203a5aa4 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:26.616040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1273/2528] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:39:26.897613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5746-07df-430f-b920-a461b0f09bde None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:26.898173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5746-07df-430f-b920-a461b0f09bde None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:26.898173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5746-07df-430f-b920-a461b0f09bde None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:26.900155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1256/2529] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:39:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:39:26.906802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e01be-d074-4dd9-9062-2a9fa1fbb8df None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:26.907103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e01be-d074-4dd9-9062-2a9fa1fbb8df None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:26.907414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e01be-d074-4dd9-9062-2a9fa1fbb8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:26.954049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c63e01be-d074-4dd9-9062-2a9fa1fbb8df None None] MFA Rules not processed for user `3cb1d1929f8b40efa72d290b23c8f1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:39:26.955367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c63e01be-d074-4dd9-9062-2a9fa1fbb8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:26.966454 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1274/2530] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:39:26 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:39:26.980430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5746-07df-430f-b920-a461b0f09bde None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:26.982220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-acff5746-07df-430f-b920-a461b0f09bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:27.040237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5746-07df-430f-b920-a461b0f09bde None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:27.043788 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bdbe2-434e-4cd3-91e3-72cf5a245676 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:27.044419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bdbe2-434e-4cd3-91e3-72cf5a245676 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:27.044703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bdbe2-434e-4cd3-91e3-72cf5a245676 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:27.044980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bdbe2-434e-4cd3-91e3-72cf5a245676 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:27.055786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bdbe2-434e-4cd3-91e3-72cf5a245676 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:27.057214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bdbe2-434e-4cd3-91e3-72cf5a245676 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:27.068721 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1257/2531] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:39:27.252254 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97af022-0b15-490d-b5b0-cea7fbc3a709 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:27.252550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97af022-0b15-490d-b5b0-cea7fbc3a709 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:27.252833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97af022-0b15-490d-b5b0-cea7fbc3a709 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:27.254660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1275/2532] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:39:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:39:27.259991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3880f-7b8d-4f7f-a143-ddb2140b66fb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:27.260140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3880f-7b8d-4f7f-a143-ddb2140b66fb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:27.260423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3880f-7b8d-4f7f-a143-ddb2140b66fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:27.278787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-81a3880f-7b8d-4f7f-a143-ddb2140b66fb None None] MFA Rules not processed for user `25123d6cb4fc417899321ecdb3c76b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:39:27.280049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-81a3880f-7b8d-4f7f-a143-ddb2140b66fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:27.287825 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1258/2533] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:39:27 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:39:27.300291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97af022-0b15-490d-b5b0-cea7fbc3a709 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:27.311204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97af022-0b15-490d-b5b0-cea7fbc3a709 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:27.315476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:27.316107 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:27.316393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:27.316673 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:27.323674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:27.325105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:27.332894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1276/2534] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:39:31.051122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b73eac-d316-45d4-bf5e-ffa293a6dc7f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:31.051601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b73eac-d316-45d4-bf5e-ffa293a6dc7f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:31.051709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b73eac-d316-45d4-bf5e-ffa293a6dc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:31.069688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-30b73eac-d316-45d4-bf5e-ffa293a6dc7f None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:39:31.071627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-30b73eac-d316-45d4-bf5e-ffa293a6dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:31.080045 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1259/2535] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:39:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:39:31.103144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:31.115221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549a90-eef7-4fce-bb72-0d964ab80e01 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:31.120220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:31.120852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:31.121144 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:31.121424 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:31.130085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:31.131892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:31.140378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1277/2536] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:39:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:39:56.349945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff7fa-d081-4e7b-a8c5-6e0005088a20 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:56.350542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff7fa-d081-4e7b-a8c5-6e0005088a20 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:56.350542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff7fa-d081-4e7b-a8c5-6e0005088a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:56.368039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4e0ff7fa-d081-4e7b-a8c5-6e0005088a20 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:39:56.369249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4e0ff7fa-d081-4e7b-a8c5-6e0005088a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:56.377055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1260/2537] 10.222.0.11 () {58 vars in 967 bytes} [Thu Nov 11 16:39:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:39:56.390483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:56.402219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d06e2-0406-43df-8394-4d93cf0211f1 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:56.407316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8e9ce-a6c2-446f-9e20-503615232cc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:56.408891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8e9ce-a6c2-446f-9e20-503615232cc7 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:56.414409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8e9ce-a6c2-446f-9e20-503615232cc7 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:56.414409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8e9ce-a6c2-446f-9e20-503615232cc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:56.417337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8e9ce-a6c2-446f-9e20-503615232cc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:56.418946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8e9ce-a6c2-446f-9e20-503615232cc7 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:56.427198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1278/2538] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:39:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:39:59.557661 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ad8ed-d435-4a56-bc1c-0578ef93762f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:59.558237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ad8ed-d435-4a56-bc1c-0578ef93762f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:59.558339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ad8ed-d435-4a56-bc1c-0578ef93762f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:59.564700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1261/2539] 10.222.0.11 () {54 vars in 921 bytes} [Thu Nov 11 16:39:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:39:59.567357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c1bb-647f-4f7d-927a-5322abdf62ce None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:59.567820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c1bb-647f-4f7d-927a-5322abdf62ce None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:59.567991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c1bb-647f-4f7d-927a-5322abdf62ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:59.588825 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a6c7c1bb-647f-4f7d-927a-5322abdf62ce None None] MFA Rules not processed for user `25123d6cb4fc417899321ecdb3c76b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:39:59.590199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a6c7c1bb-647f-4f7d-927a-5322abdf62ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:39:59.597381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1279/2540] 10.222.0.11 () {58 vars in 1018 bytes} [Thu Nov 11 16:39:59 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:39:59.609611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ad8ed-d435-4a56-bc1c-0578ef93762f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:39:59.621748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ad8ed-d435-4a56-bc1c-0578ef93762f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:39:59.625258 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:39:59.625892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:39:59.626263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:39:59.626886 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:39:59.633649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:39:59.635121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:39:59.643283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1262/2541] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:39:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:40:25.230129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:25.230691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:25.230792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:25.247858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] MFA Rules not processed for user `9cec710bddca4e6c890c99580d172053`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:25.249052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:25.302531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1280/2542] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:40:44.819975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:44.829004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceca493-405b-40fb-ae37-f93645c3a2ad service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:44.832792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:44.836608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:44.836608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:44.836608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:44.836608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:44.900369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:44.915762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:44.915762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1263/2543] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:40:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:40:48.678481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:48.679935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:48.694905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3c545-78dd-4ebf-b032-fc09fad173cb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:48.700245 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:48.701114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:48.701398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:48.701678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] PATH_INFO: `/v3/users/c0e12bd4237643e99e03e73f6c5c69f0` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:48.702918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e12bd4237643e99e03e73f6c5c69f0)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:48.704951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:48.917313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e12bd4237643e99e03e73f6c5c69f0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:48.928906 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e12bd4237643e99e03e73f6c5c69f0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:48.929615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e12bd4237643e99e03e73f6c5c69f0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:48.930250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e12bd4237643e99e03e73f6c5c69f0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:48.937426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-228d58d7-3474-47b2-a0b9-76e68bfba848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e12bd4237643e99e03e73f6c5c69f0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:49.010896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1281/2544] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:40:48 2021] DELETE /identity/v3/users/c0e12bd4237643e99e03e73f6c5c69f0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:40:49.246434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:49.256374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144463ac-30f9-4f81-b260-4ed083134957 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:49.314419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:49.315297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:49.315577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:49.315853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] PATH_INFO: `/v3/projects/17202b7fa9ac43bc9736f2eed5c623f3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:49.317029 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17202b7fa9ac43bc9736f2eed5c623f3)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:49.319025 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:49.455663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17202b7fa9ac43bc9736f2eed5c623f3', 'request_id': 'req-abbe699f-a2e7-489b-85fc-cb294482a152'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:49.461085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17202b7fa9ac43bc9736f2eed5c623f3', 'request_id': 'req-abbe699f-a2e7-489b-85fc-cb294482a152'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:49.542699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17202b7fa9ac43bc9736f2eed5c623f3', 'request_id': 'req-abbe699f-a2e7-489b-85fc-cb294482a152'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:49.554695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] The token cache is being invalidate because project 17202b7fa9ac43bc9736f2eed5c623f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:40:49.554988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:49.558263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-abbe699f-a2e7-489b-85fc-cb294482a152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:49.558263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1264/2545] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:40:49 2021] DELETE /identity/v3/projects/17202b7fa9ac43bc9736f2eed5c623f3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:40:49.564060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0e7c-f9e5-4d82-a3ac-c1ce662b7905 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:49.564060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0e7c-f9e5-4d82-a3ac-c1ce662b7905 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:49.565032 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d0e7c-f9e5-4d82-a3ac-c1ce662b7905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:49.583773 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-072d0e7c-f9e5-4d82-a3ac-c1ce662b7905 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:49.585082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-072d0e7c-f9e5-4d82-a3ac-c1ce662b7905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:49.647414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1282/2546] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:40:49.655823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fc862-1b34-4c41-9db8-5302cbdae3fb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:49.656128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fc862-1b34-4c41-9db8-5302cbdae3fb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:49.656407 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fc862-1b34-4c41-9db8-5302cbdae3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:49.674312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1c7fc862-1b34-4c41-9db8-5302cbdae3fb None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:49.675506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1c7fc862-1b34-4c41-9db8-5302cbdae3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:49.683854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1265/2547] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:40:49.688129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d0e7c-f9e5-4d82-a3ac-c1ce662b7905 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:49.698243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d0e7c-f9e5-4d82-a3ac-c1ce662b7905 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:49.702946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:49.703594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:49.703879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:49.704158 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:49.704898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:40:49.705203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:49.706829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:49.718776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1283/2548] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:40:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:40:49.723006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fc862-1b34-4c41-9db8-5302cbdae3fb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:49.732156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fc862-1b34-4c41-9db8-5302cbdae3fb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:49.736808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:49.737457 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:49.737736 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:49.738010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:49.738783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:49.740668 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:49.840936 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1266/2549] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:40:49 2021] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:40:49.846206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:49.857465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00dd2d-a04c-404c-9f97-6fab2aada3eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:49.923139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:49.923814 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:49.924121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:49.924389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:49.925129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:49.927085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:50.054069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1284/2550] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:40:49 2021] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:40:50.059737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:50.073952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d21e8-24da-4a25-82eb-e8cf849654cc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:50.079383 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:50.080060 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:50.080340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:50.080623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:50.081639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:50.084148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:50.096779 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1267/2551] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:40:50 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:40:50.102367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:50.116848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb152-5189-4cfc-a277-9b493dcc2aae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:50.122540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4abba5-34f1-4140-8083-5c603e80b5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:50.123250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4abba5-34f1-4140-8083-5c603e80b5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:50.123531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4abba5-34f1-4140-8083-5c603e80b5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:50.123810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4abba5-34f1-4140-8083-5c603e80b5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:50.125652 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4abba5-34f1-4140-8083-5c603e80b5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:50.128936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4abba5-34f1-4140-8083-5c603e80b5a7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:50.141298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1285/2552] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:40:50 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:40:50.145895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:50.157065 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98164a9-197f-4623-b790-70e311eed34b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:50.161791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:50.162737 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:50.163014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:50.163288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] PATH_INFO: `/v3/projects/6ab7eed5ecf444b3bbe5f6ae205ff6e0/users/2a77c087329644429135b4fd73d63d00/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:50.179499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab7eed5ecf444b3bbe5f6ae205ff6e0, user_id=2a77c087329644429135b4fd73d63d00, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:50.182267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:50.268611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1268/2553] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:40:50 2021] PUT /identity/v3/projects/6ab7eed5ecf444b3bbe5f6ae205ff6e0/users/2a77c087329644429135b4fd73d63d00/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:40:50.279790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f6fb-7908-4150-a528-9f4b612c9a1e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:50.280076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f6fb-7908-4150-a528-9f4b612c9a1e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:50.280352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f6fb-7908-4150-a528-9f4b612c9a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:50.311733 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d812f6fb-7908-4150-a528-9f4b612c9a1e None None] MFA Rules not processed for user `2a77c087329644429135b4fd73d63d00`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:50.312956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d812f6fb-7908-4150-a528-9f4b612c9a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:50.390484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1286/2554] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:50 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:40:50.403431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:50.405428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:50.487444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3c33-b6ae-490f-b77a-5c1b6f372d19 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:50.494391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5d411-7359-4dac-bad7-d45e7878ec79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:50.495212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d411-7359-4dac-bad7-d45e7878ec79 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:50.495505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d411-7359-4dac-bad7-d45e7878ec79 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:50.495787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d411-7359-4dac-bad7-d45e7878ec79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:50.504552 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5d411-7359-4dac-bad7-d45e7878ec79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:50.506158 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5d411-7359-4dac-bad7-d45e7878ec79 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:50.516106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1269/2555] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:40:50 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:40:53.778033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812f6fb-7908-4150-a528-9f4b612c9a1e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:53.848443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812f6fb-7908-4150-a528-9f4b612c9a1e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:53.853620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:53.854793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:53.855204 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:53.855499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] PATH_INFO: `/v3/users/2a77c087329644429135b4fd73d63d00` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:53.856806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a77c087329644429135b4fd73d63d00)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:53.858850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:54.074461 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a77c087329644429135b4fd73d63d00'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:54.087755 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a77c087329644429135b4fd73d63d00'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:54.089387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a77c087329644429135b4fd73d63d00'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:54.089948 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a77c087329644429135b4fd73d63d00'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:54.097160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a77c087329644429135b4fd73d63d00'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:54.172753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1287/2556] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:40:53 2021] DELETE /identity/v3/users/2a77c087329644429135b4fd73d63d00 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:40:54.177471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:54.177974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:54.178132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:54.196205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:54.199618 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:54.301079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1270/2557] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:40:54.317379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:54.319686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:54.431640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ca3a5-fe9c-46c9-be54-384aef2ff6a8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:54.441607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4db9c-e9d4-4e32-adde-0353c96c83bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:54.442793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4db9c-e9d4-4e32-adde-0353c96c83bd service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:54.443306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4db9c-e9d4-4e32-adde-0353c96c83bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:54.443947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4db9c-e9d4-4e32-adde-0353c96c83bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:54.467321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4db9c-e9d4-4e32-adde-0353c96c83bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:54.469124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4db9c-e9d4-4e32-adde-0353c96c83bd service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:54.498378 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1288/2558] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:40:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:40:54.965583 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:54.967738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:54.985652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb399859-0176-45a4-9246-59446f0de1f0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:54.991380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:54.995639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:54.995639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:54.995639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] PATH_INFO: `/v3/projects/6ab7eed5ecf444b3bbe5f6ae205ff6e0` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:54.995639 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab7eed5ecf444b3bbe5f6ae205ff6e0)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:54.997089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:55.133625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab7eed5ecf444b3bbe5f6ae205ff6e0', 'request_id': 'req-2f6533a2-4b3c-49d8-91b5-a4826a248250'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:55.140611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab7eed5ecf444b3bbe5f6ae205ff6e0', 'request_id': 'req-2f6533a2-4b3c-49d8-91b5-a4826a248250'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:55.253101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab7eed5ecf444b3bbe5f6ae205ff6e0', 'request_id': 'req-2f6533a2-4b3c-49d8-91b5-a4826a248250'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:55.277396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] The token cache is being invalidate because project 6ab7eed5ecf444b3bbe5f6ae205ff6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:40:55.277943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:55.279382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2f6533a2-4b3c-49d8-91b5-a4826a248250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:40:55.288423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1271/2559] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:40:54 2021] DELETE /identity/v3/projects/6ab7eed5ecf444b3bbe5f6ae205ff6e0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:40:55.290326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca6349-fa17-407e-802b-8d4775cfa9c4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.292359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca6349-fa17-407e-802b-8d4775cfa9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.292359 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca6349-fa17-407e-802b-8d4775cfa9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.312759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-89ca6349-fa17-407e-802b-8d4775cfa9c4 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:55.312759 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-89ca6349-fa17-407e-802b-8d4775cfa9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:55.377675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1289/2560] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:40:55.386803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2d2b-4df8-4f9b-b31e-314615d5db35 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.387216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2d2b-4df8-4f9b-b31e-314615d5db35 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.387505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd2d2b-4df8-4f9b-b31e-314615d5db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.406305 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-08fd2d2b-4df8-4f9b-b31e-314615d5db35 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:55.407541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-08fd2d2b-4df8-4f9b-b31e-314615d5db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:55.415691 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1272/2561] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:40:55.420464 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca6349-fa17-407e-802b-8d4775cfa9c4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:55.430059 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca6349-fa17-407e-802b-8d4775cfa9c4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:55.435933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:55.436594 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.436877 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.437152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.437904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:40:55.438240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:55.439870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:55.456048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1290/2562] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:40:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:40:55.458818 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd2d2b-4df8-4f9b-b31e-314615d5db35 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:55.469811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd2d2b-4df8-4f9b-b31e-314615d5db35 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:55.480007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:55.480681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.480968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.481245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.486560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:55.486560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:55.605574 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1273/2563] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:40:55 2021] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:40:55.609912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:55.621442 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fca35-f925-4f17-bb39-c7d612cf8a6d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:55.679726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:55.680402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.680687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.680965 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.681684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:55.684121 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:55.796638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1291/2564] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:40:55 2021] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:40:55.800865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:55.812323 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd646-6a79-4f64-88fd-c34bf3877ffa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:55.817242 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:55.817934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.818435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.818891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.819816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:55.821487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:55.832743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1274/2565] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:40:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:40:55.836888 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:55.847472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5d47d-cb1b-4215-8c89-de2e924df753 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:55.852284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff9fd1-4deb-4896-ac7f-37721643bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:55.853063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9fd1-4deb-4896-ac7f-37721643bac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.853353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9fd1-4deb-4896-ac7f-37721643bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.853635 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9fd1-4deb-4896-ac7f-37721643bac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.854450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff9fd1-4deb-4896-ac7f-37721643bac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:55.856135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff9fd1-4deb-4896-ac7f-37721643bac1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:55.866258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1292/2566] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:40:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:40:55.871261 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:55.881009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523ab8b-f1d6-41f8-87a7-48cc4e383128 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:55.886315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:55.887194 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.887480 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.887755 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] PATH_INFO: `/v3/projects/ce8a22f3dbaf4f87997f3d6ff372467d/users/e3a87cdc6eed4edf969938e897559e0c/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:55.902977 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8a22f3dbaf4f87997f3d6ff372467d, user_id=e3a87cdc6eed4edf969938e897559e0c, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:55.905664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:55.976904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1275/2567] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:40:55 2021] PUT /identity/v3/projects/ce8a22f3dbaf4f87997f3d6ff372467d/users/e3a87cdc6eed4edf969938e897559e0c/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:40:55.990071 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b049d-744b-4a7e-8140-dffc2c1277bf None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:55.990423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b049d-744b-4a7e-8140-dffc2c1277bf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:55.990715 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b049d-744b-4a7e-8140-dffc2c1277bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:56.017289 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e57b049d-744b-4a7e-8140-dffc2c1277bf None None] MFA Rules not processed for user `e3a87cdc6eed4edf969938e897559e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:56.018811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e57b049d-744b-4a7e-8140-dffc2c1277bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:56.105669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1293/2568] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:55 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:40:56.115626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:40:56.117490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:56.180182 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00097b-970f-42b4-bd8f-30139bd78ca4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:40:56.189919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ecf3f-3ec3-4798-8720-e25f4efbff4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:40:56.190726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ecf3f-3ec3-4798-8720-e25f4efbff4e service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:56.191027 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ecf3f-3ec3-4798-8720-e25f4efbff4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:56.191352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ecf3f-3ec3-4798-8720-e25f4efbff4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:56.203711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ecf3f-3ec3-4798-8720-e25f4efbff4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:40:56.205325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ecf3f-3ec3-4798-8720-e25f4efbff4e service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:40:56.226313 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1276/2569] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:40:56 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:40:59.438388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:40:59.438865 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:40:59.438984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:40:59.456978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] MFA Rules not processed for user `98f235f4cb944eb6926375e2bb551741`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:40:59.461472 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:40:59.510837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1294/2570] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:40:59 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:05.562993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd48d-fb4f-4ae6-a885-00e61278ce6d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:05.563461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd48d-fb4f-4ae6-a885-00e61278ce6d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:05.563560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd48d-fb4f-4ae6-a885-00e61278ce6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:05.581882 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4a5dd48d-fb4f-4ae6-a885-00e61278ce6d None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:05.583697 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4a5dd48d-fb4f-4ae6-a885-00e61278ce6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:05.641039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1277/2571] 10.222.0.11 () {58 vars in 967 bytes} [Thu Nov 11 16:41:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:05.783485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:05.785971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:05.853589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9bb9-ab3e-438a-8e2f-6e4dfb3f4b20 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:05.858928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c7f3-6bbd-4d09-9e26-8acd0b7441ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:05.859573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c7f3-6bbd-4d09-9e26-8acd0b7441ed service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:05.860379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c7f3-6bbd-4d09-9e26-8acd0b7441ed service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:05.860379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c7f3-6bbd-4d09-9e26-8acd0b7441ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:05.869369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c7f3-6bbd-4d09-9e26-8acd0b7441ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:05.871122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c7f3-6bbd-4d09-9e26-8acd0b7441ed service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:05.880388 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1295/2572] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:41:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:41:06.726754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd48d-fb4f-4ae6-a885-00e61278ce6d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:06.792109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd48d-fb4f-4ae6-a885-00e61278ce6d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:06.797353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:06.798238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:06.798532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:06.798808 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] PATH_INFO: `/v3/users/e3a87cdc6eed4edf969938e897559e0c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:06.801566 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a87cdc6eed4edf969938e897559e0c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:06.801930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:07.163007 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a87cdc6eed4edf969938e897559e0c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:07.163678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a87cdc6eed4edf969938e897559e0c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:07.176992 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a87cdc6eed4edf969938e897559e0c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:07.177693 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a87cdc6eed4edf969938e897559e0c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:07.265326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a87cdc6eed4edf969938e897559e0c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:07.278634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1278/2573] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:06 2021] DELETE /identity/v3/users/e3a87cdc6eed4edf969938e897559e0c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:07.283829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:07.284304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:07.284529 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:07.303780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:07.305040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:07.363956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1296/2574] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:07.374564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:07.376094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:07.436047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c285f8-1d29-4f0e-b41e-71db52ba5af4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:07.439631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8faba6-03fe-42f3-89b2-6278cd1fc9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:07.440272 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8faba6-03fe-42f3-89b2-6278cd1fc9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:07.440557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8faba6-03fe-42f3-89b2-6278cd1fc9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:07.440835 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8faba6-03fe-42f3-89b2-6278cd1fc9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:07.450427 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8faba6-03fe-42f3-89b2-6278cd1fc9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:07.451974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8faba6-03fe-42f3-89b2-6278cd1fc9e9 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:07.461673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1279/2575] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:07.960033 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:07.961491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:07.974112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475da4b-c387-4542-a85b-d3d208a8efce None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:07.978896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:07.979766 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:07.980052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:07.980330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] PATH_INFO: `/v3/projects/ce8a22f3dbaf4f87997f3d6ff372467d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:07.984104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8a22f3dbaf4f87997f3d6ff372467d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:07.987953 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:08.104164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8a22f3dbaf4f87997f3d6ff372467d', 'request_id': 'req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:08.110809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8a22f3dbaf4f87997f3d6ff372467d', 'request_id': 'req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:08.218956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8a22f3dbaf4f87997f3d6ff372467d', 'request_id': 'req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:08.229795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] The token cache is being invalidate because project ce8a22f3dbaf4f87997f3d6ff372467d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:08.230171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:08.230882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4002d1a1-1a5b-4dd9-8989-be11bfd55b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:08.232619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1297/2576] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:07 2021] DELETE /identity/v3/projects/ce8a22f3dbaf4f87997f3d6ff372467d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:08.238589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b956b-0c08-4c10-baae-a20bc4734ba1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.239062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b956b-0c08-4c10-baae-a20bc4734ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.239180 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b956b-0c08-4c10-baae-a20bc4734ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.261146 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-983b956b-0c08-4c10-baae-a20bc4734ba1 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:08.262269 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-983b956b-0c08-4c10-baae-a20bc4734ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:08.332666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1280/2577] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:41:08.340959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bc097-70d5-45a1-9033-539a4765a503 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.341566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bc097-70d5-45a1-9033-539a4765a503 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.341566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bc097-70d5-45a1-9033-539a4765a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.364762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-359bc097-70d5-45a1-9033-539a4765a503 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:08.366025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-359bc097-70d5-45a1-9033-539a4765a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:08.377924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1298/2578] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:08.382382 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b956b-0c08-4c10-baae-a20bc4734ba1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:08.395169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b956b-0c08-4c10-baae-a20bc4734ba1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:08.402489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:08.403620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.404043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.404543 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.405540 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:41:08.405959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:08.407751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:08.422777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1281/2579] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:41:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:41:08.427022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bc097-70d5-45a1-9033-539a4765a503 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:08.440950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bc097-70d5-45a1-9033-539a4765a503 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:08.446430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:08.447341 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.447802 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.448131 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.449106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:08.451850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:08.578229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1299/2580] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:08 2021] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:08.579448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:08.597551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202aa9ab-b0d3-4538-96d3-2a1b2c645c9b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:08.658760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:08.659345 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.659624 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.660314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.661471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:08.663554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:08.759251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1282/2581] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:08 2021] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:08.764364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:08.778858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce0649-98c7-44dc-a1d2-e5d06d44de76 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:08.784355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:08.785073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.785360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.785639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.786417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:08.788153 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:08.803023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1300/2582] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:08 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:41:08.804343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:08.816448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b767b3-7032-4e61-8465-918910ba290b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:08.821257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456d8d4-0be7-46a4-a62d-080e1b66f15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:08.821993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d8d4-0be7-46a4-a62d-080e1b66f15d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.824022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d8d4-0be7-46a4-a62d-080e1b66f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.824022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d8d4-0be7-46a4-a62d-080e1b66f15d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.824022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456d8d4-0be7-46a4-a62d-080e1b66f15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:08.825253 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456d8d4-0be7-46a4-a62d-080e1b66f15d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:08.840642 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1283/2583] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:08 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:08.842417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:08.853537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb8ff-fce3-44ff-badb-d703e050575c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:08.859879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:08.860622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.861507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.861507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] PATH_INFO: `/v3/projects/405e175213ae459fa661f2fbfdb2c39b/users/50edb28251fb488593d7736fc391dac7/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:08.877045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405e175213ae459fa661f2fbfdb2c39b, user_id=50edb28251fb488593d7736fc391dac7, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:08.879730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:08.967609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1301/2584] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:08 2021] PUT /identity/v3/projects/405e175213ae459fa661f2fbfdb2c39b/users/50edb28251fb488593d7736fc391dac7/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:08.979199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf72f-e307-45f8-a759-3df506a860be None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:08.979555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf72f-e307-45f8-a759-3df506a860be None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:08.979848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf72f-e307-45f8-a759-3df506a860be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.009051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b76cf72f-e307-45f8-a759-3df506a860be None None] MFA Rules not processed for user `50edb28251fb488593d7736fc391dac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:09.010366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b76cf72f-e307-45f8-a759-3df506a860be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:09.078906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1284/2585] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:08 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:41:09.083376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:09.145183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fc188-b6c4-44a6-b0d4-2be219b1c036 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:09.150451 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:09.151124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.151410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.151688 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.152434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:09.154538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:09.257045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1302/2586] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:09 2021] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:09.262074 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cf72f-e307-45f8-a759-3df506a860be None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:09.279796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cf72f-e307-45f8-a759-3df506a860be None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:09.342206 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:09.343034 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.343247 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.343539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.344251 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:09.346207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:09.433667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1285/2587] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:09 2021] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:41:09.438813 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:09.450012 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a0df5-cd72-48b3-b236-d5d97ffea7a2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:09.455365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:09.456137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.456497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.456999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.457764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:09.459739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:09.475171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1303/2588] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:09.476114 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:09.487075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd76f6-3fba-4abf-9d89-c3a5c524ae1e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:09.495551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:09.495551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.495551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.495551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] PATH_INFO: `/v3/projects/61ed014783874e6db29365f8782c1e0b/users/d8406cebc8424d8e8ee10ebf24d2a08c/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.508265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ed014783874e6db29365f8782c1e0b, user_id=d8406cebc8424d8e8ee10ebf24d2a08c, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:09.510978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:09.594664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1286/2589] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:09 2021] PUT /identity/v3/projects/61ed014783874e6db29365f8782c1e0b/users/d8406cebc8424d8e8ee10ebf24d2a08c/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:09.598686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:09.609726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a4791-35d4-45b3-9282-0f4b142fc2b7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:09.672727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23304f-7003-4dd8-aa4c-7afbc98a44f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:09.673507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23304f-7003-4dd8-aa4c-7afbc98a44f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.673857 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23304f-7003-4dd8-aa4c-7afbc98a44f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.674316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23304f-7003-4dd8-aa4c-7afbc98a44f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.675084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23304f-7003-4dd8-aa4c-7afbc98a44f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:09.676703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23304f-7003-4dd8-aa4c-7afbc98a44f0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:09.691611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1304/2590] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:09 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:41:09.692815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:09.704879 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71563106-d57e-4d1f-ab65-84529cb8358f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:09.710266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:09.711169 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.711454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.711750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] PATH_INFO: `/v3/projects/61ed014783874e6db29365f8782c1e0b/users/d8406cebc8424d8e8ee10ebf24d2a08c/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.713787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ed014783874e6db29365f8782c1e0b, user_id=d8406cebc8424d8e8ee10ebf24d2a08c, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:09.716700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:09.729644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1287/2591] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:09 2021] PUT /identity/v3/projects/61ed014783874e6db29365f8782c1e0b/users/d8406cebc8424d8e8ee10ebf24d2a08c/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:09.740789 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.741085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.741366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.771353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] MFA Rules not processed for user `d8406cebc8424d8e8ee10ebf24d2a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:09.772749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:09.856797 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1305/2592] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:09 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:09.868108 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:09.870846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:09.931975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca84b1-c18d-48d8-bf03-bd7898cc3b59 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:09.935665 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:09.936301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:09.936579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:09.936851 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:09.945974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:09.947423 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:09.957279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1288/2593] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:09 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:10.160849 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:10.162355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:10.174221 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e64b-b31b-4c8d-b7f1-7b3a3f5f2389 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:10.177806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:10.178512 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:10.178758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:10.179037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:10.240342 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:10.241918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:10.251654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1306/2594] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:10 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:15.543803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:15.546551 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:15.602382 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:15.614513 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b870af-2879-4e36-9b97-0be1cc54d34f service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:15.617055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764646-e4c5-4a5a-897b-2b1e415221e6 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:15.619321 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:15.619537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:15.620319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:15.620481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:15.620588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:15.620678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:15.620867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] PATH_INFO: `/v3/users/50edb28251fb488593d7736fc391dac7` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:15.621014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] PATH_INFO: `/v3/users/e70d95f907604c6bad74f5e5dbf3c74c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:15.622140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70d95f907604c6bad74f5e5dbf3c74c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:15.622619 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50edb28251fb488593d7736fc391dac7)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:15.625275 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:15.625504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:15.837351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70d95f907604c6bad74f5e5dbf3c74c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.837582 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50edb28251fb488593d7736fc391dac7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.838621 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70d95f907604c6bad74f5e5dbf3c74c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.855890 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50edb28251fb488593d7736fc391dac7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.856474 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70d95f907604c6bad74f5e5dbf3c74c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.856684 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50edb28251fb488593d7736fc391dac7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.857202 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50edb28251fb488593d7736fc391dac7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.858557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70d95f907604c6bad74f5e5dbf3c74c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.864739 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50edb28251fb488593d7736fc391dac7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.918459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ab978458-a36f-4b07-b8c3-8d424bdd0dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70d95f907604c6bad74f5e5dbf3c74c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:15.931459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1289/2595] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:15 2021] DELETE /identity/v3/users/e70d95f907604c6bad74f5e5dbf3c74c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:15.976650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1307/2596] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:15 2021] DELETE /identity/v3/users/50edb28251fb488593d7736fc391dac7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:15.981016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:15.981318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:15.981605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:15.999756 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:16.001049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:16.061121 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1290/2597] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:41:16.071123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:16.072552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:16.129282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa49dac-f33f-47d0-8ec6-e6f0a06f3140 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:16.132810 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:16.133481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:16.133756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:16.134028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:16.143690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:16.145248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:16.155113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1308/2598] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:41:16.206815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:16.208324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:16.222917 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b46d4c-34ed-471f-8614-2c4bce33c68c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:16.229190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:16.232293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:16.232293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:16.232293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] PATH_INFO: `/v3/projects/76c17d79aa3e434b8a66bfd4f0085b60` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:16.232747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c17d79aa3e434b8a66bfd4f0085b60)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:16.234945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:16.400805 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c17d79aa3e434b8a66bfd4f0085b60', 'request_id': 'req-ecc1db29-860d-4512-a8cb-7b62086ab9d0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.407830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c17d79aa3e434b8a66bfd4f0085b60', 'request_id': 'req-ecc1db29-860d-4512-a8cb-7b62086ab9d0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.470512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c17d79aa3e434b8a66bfd4f0085b60', 'request_id': 'req-ecc1db29-860d-4512-a8cb-7b62086ab9d0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.482142 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] The token cache is being invalidate because project 76c17d79aa3e434b8a66bfd4f0085b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:16.487296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.487296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.487296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1291/2599] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:16 2021] DELETE /identity/v3/projects/76c17d79aa3e434b8a66bfd4f0085b60 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:16.489016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:16.498629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740d848-b868-43e7-8956-3a1c590aa9da service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:16.554682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:16.555552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:16.555837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:16.556206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] PATH_INFO: `/v3/users/ecdc61c2a0824e9b971d52744cae3ff9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:16.557456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdc61c2a0824e9b971d52744cae3ff9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:16.559431 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:16.570159 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:16.573487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:16.587185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1db29-860d-4512-a8cb-7b62086ab9d0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:16.592628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:16.593492 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:16.593773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:16.594047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] PATH_INFO: `/v3/projects/405e175213ae459fa661f2fbfdb2c39b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:16.596080 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] RBAC: Authorizing `identity:delete_project(project_id=405e175213ae459fa661f2fbfdb2c39b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:16.602579 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:16.762290 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdc61c2a0824e9b971d52744cae3ff9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.768826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405e175213ae459fa661f2fbfdb2c39b', 'request_id': 'req-93ea9971-7796-421e-a332-e57ac98f804f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.769972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405e175213ae459fa661f2fbfdb2c39b', 'request_id': 'req-93ea9971-7796-421e-a332-e57ac98f804f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.777573 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdc61c2a0824e9b971d52744cae3ff9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.778444 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdc61c2a0824e9b971d52744cae3ff9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.779074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdc61c2a0824e9b971d52744cae3ff9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.785747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdc61c2a0824e9b971d52744cae3ff9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.841791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405e175213ae459fa661f2fbfdb2c39b', 'request_id': 'req-93ea9971-7796-421e-a332-e57ac98f804f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.853183 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] The token cache is being invalidate because project 405e175213ae459fa661f2fbfdb2c39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:16.853475 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.854133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:16.855760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1292/2600] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:16 2021] DELETE /identity/v3/projects/405e175213ae459fa661f2fbfdb2c39b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:16.859611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:16.860912 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:16.905474 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1309/2601] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:16 2021] DELETE /identity/v3/users/ecdc61c2a0824e9b971d52744cae3ff9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:16.924243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea9971-7796-421e-a332-e57ac98f804f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:16.979752 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:16.980708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:16.980993 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:16.981271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] PATH_INFO: `/v3/users/d8406cebc8424d8e8ee10ebf24d2a08c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:16.982561 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8406cebc8424d8e8ee10ebf24d2a08c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:16.984608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:17.166045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:17.167522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:17.180351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad29c7e-76f0-4529-99b9-2e8ba315922d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:17.186258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:17.186258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:17.186579 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:17.186737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] PATH_INFO: `/v3/projects/c9ed6c0e6d524e5eb66ddbf0d039f10e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:17.187944 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ed6c0e6d524e5eb66ddbf0d039f10e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:17.189836 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:17.267518 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8406cebc8424d8e8ee10ebf24d2a08c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.268486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8406cebc8424d8e8ee10ebf24d2a08c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.280924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8406cebc8424d8e8ee10ebf24d2a08c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.281652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8406cebc8424d8e8ee10ebf24d2a08c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.293449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ed6c0e6d524e5eb66ddbf0d039f10e', 'request_id': 'req-63806587-ebfa-478c-8119-3b497a6801f1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.299925 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ed6c0e6d524e5eb66ddbf0d039f10e', 'request_id': 'req-63806587-ebfa-478c-8119-3b497a6801f1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.341962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8406cebc8424d8e8ee10ebf24d2a08c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.354613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1293/2602] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:16 2021] DELETE /identity/v3/users/d8406cebc8424d8e8ee10ebf24d2a08c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:17.390735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ed6c0e6d524e5eb66ddbf0d039f10e', 'request_id': 'req-63806587-ebfa-478c-8119-3b497a6801f1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.401999 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] The token cache is being invalidate because project c9ed6c0e6d524e5eb66ddbf0d039f10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:17.403719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.403719 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-63806587-ebfa-478c-8119-3b497a6801f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.404538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1310/2603] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:17 2021] DELETE /identity/v3/projects/c9ed6c0e6d524e5eb66ddbf0d039f10e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:17.772319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:17.773764 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:17.836839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6f6f2-183f-4e3b-bdad-dccb11b454ee admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:17.841416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:17.842487 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:17.842772 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:17.843052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] PATH_INFO: `/v3/projects/61ed014783874e6db29365f8782c1e0b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:17.844239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ed014783874e6db29365f8782c1e0b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:17.846140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:17.956434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ed014783874e6db29365f8782c1e0b', 'request_id': 'req-f2f2f312-fc3b-4e24-8e9c-08576f938441'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:17.961581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ed014783874e6db29365f8782c1e0b', 'request_id': 'req-f2f2f312-fc3b-4e24-8e9c-08576f938441'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:18.035360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ed014783874e6db29365f8782c1e0b', 'request_id': 'req-f2f2f312-fc3b-4e24-8e9c-08576f938441'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:18.047834 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] The token cache is being invalidate because project 61ed014783874e6db29365f8782c1e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:18.048044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:18.048659 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f2f2f312-fc3b-4e24-8e9c-08576f938441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:18.050257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1294/2604] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:17 2021] DELETE /identity/v3/projects/61ed014783874e6db29365f8782c1e0b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:18.056271 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761ee52-1caf-4e2c-9609-d1787166a115 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.056740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761ee52-1caf-4e2c-9609-d1787166a115 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.056852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761ee52-1caf-4e2c-9609-d1787166a115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.074951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f761ee52-1caf-4e2c-9609-d1787166a115 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:18.076181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f761ee52-1caf-4e2c-9609-d1787166a115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:18.135039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1311/2605] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:18.143264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614930a7-cb48-4d58-8267-50c65e7d509b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.143588 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614930a7-cb48-4d58-8267-50c65e7d509b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.143870 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614930a7-cb48-4d58-8267-50c65e7d509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.163897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-614930a7-cb48-4d58-8267-50c65e7d509b None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:18.165179 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-614930a7-cb48-4d58-8267-50c65e7d509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:18.174885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1295/2606] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:18.184908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761ee52-1caf-4e2c-9609-d1787166a115 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.188823 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761ee52-1caf-4e2c-9609-d1787166a115 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:18.193439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:18.194089 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.194413 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.194698 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.195446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:41:18.195758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:18.197427 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:18.208952 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1312/2607] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:41:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:41:18.217893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614930a7-cb48-4d58-8267-50c65e7d509b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.227426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614930a7-cb48-4d58-8267-50c65e7d509b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:18.232845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:18.233485 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.233761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.234165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.234892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:18.236823 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:18.319880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1296/2608] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:18 2021] POST /identity/v3/projects => generated 407 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:18.323983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.333806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9bba-373c-4afe-a96b-7d1102e2d8d7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:18.387712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:18.389127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.389426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.389710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.390624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:18.392355 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:18.479006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1313/2609] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:18 2021] POST /identity/v3/users => generated 304 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:41:18.483128 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.493147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bfaff-dddf-470b-838d-a28797bd315c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:18.497684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:18.498353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.498632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.498904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.499634 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:18.501216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:18.511188 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1297/2610] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:18.520918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.531568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320308e9-aa93-4636-a792-60bded8fa10b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:18.536448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6707f7-b709-4c62-9294-d6b1b2b32ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:18.537114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6707f7-b709-4c62-9294-d6b1b2b32ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.537400 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6707f7-b709-4c62-9294-d6b1b2b32ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.537682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6707f7-b709-4c62-9294-d6b1b2b32ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.538465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6707f7-b709-4c62-9294-d6b1b2b32ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:18.540067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6707f7-b709-4c62-9294-d6b1b2b32ca8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:18.550533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1314/2611] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:18.554478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.564270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf799e-94e2-4e27-9a41-6772e180de1f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:18.568773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:18.569628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.569959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.570198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] PATH_INFO: `/v3/projects/15a8f25f33d041cbaab1d9a18f0acc16/users/c59fbb6ae9d142a0b45d3c0e8b246672/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.584920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a8f25f33d041cbaab1d9a18f0acc16, user_id=c59fbb6ae9d142a0b45d3c0e8b246672, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:18.587596 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:18.661542 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1298/2612] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:18 2021] PUT /identity/v3/projects/15a8f25f33d041cbaab1d9a18f0acc16/users/c59fbb6ae9d142a0b45d3c0e8b246672/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:18.672716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8c66-b1c9-40ab-8132-1643f1e8f34a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.673351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8c66-b1c9-40ab-8132-1643f1e8f34a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.673351 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b8c66-b1c9-40ab-8132-1643f1e8f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.699232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fa5b8c66-b1c9-40ab-8132-1643f1e8f34a None None] MFA Rules not processed for user `c59fbb6ae9d142a0b45d3c0e8b246672`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:18.700482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fa5b8c66-b1c9-40ab-8132-1643f1e8f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:18.763834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1315/2613] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:18 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:18.768528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.829004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498120a-55b7-48af-969d-7daf32b7a386 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:18.833837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:18.834625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:18.834909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:18.835191 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:18.835898 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:18.838390 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:18.948541 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1299/2614] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:18 2021] POST /identity/v3/projects => generated 409 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:18.952811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8c66-b1c9-40ab-8132-1643f1e8f34a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:18.964379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b8c66-b1c9-40ab-8132-1643f1e8f34a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:19.020375 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:19.021048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.021368 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.021650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:19.022395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:19.024306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:19.145186 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1316/2615] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:18 2021] POST /identity/v3/users => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:19.149058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:19.159453 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ef6a-dc88-4743-adf5-23110d1ed76d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:19.164335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:19.164991 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.165277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.165556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:19.166335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:19.167971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:19.180147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1300/2616] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:19.184291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:19.194763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b036-be90-43be-8fe5-2e3cd882420a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:19.199257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:19.200125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.200405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.200674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] PATH_INFO: `/v3/projects/d5e5a04266744b9bb76767eb23654cdd/users/ee993d25324d41da805a9de26430b670/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:19.214828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e5a04266744b9bb76767eb23654cdd, user_id=ee993d25324d41da805a9de26430b670, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:19.217489 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:19.287036 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1317/2617] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:19 2021] PUT /identity/v3/projects/d5e5a04266744b9bb76767eb23654cdd/users/ee993d25324d41da805a9de26430b670/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:19.291084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:19.302072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e87c7a-3b91-4d05-a620-1d909e31e546 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:19.355442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889deddb-3f42-4b03-8079-dd50fe95713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:19.356096 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889deddb-3f42-4b03-8079-dd50fe95713d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.356374 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889deddb-3f42-4b03-8079-dd50fe95713d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.356646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889deddb-3f42-4b03-8079-dd50fe95713d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:19.357916 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889deddb-3f42-4b03-8079-dd50fe95713d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:19.359694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889deddb-3f42-4b03-8079-dd50fe95713d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:19.369009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1301/2618] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:19 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:19.373834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:19.383885 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f47971-6ea9-46fc-9403-0b630b96a4e6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:19.388459 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:19.389420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.389705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.389982 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] PATH_INFO: `/v3/projects/d5e5a04266744b9bb76767eb23654cdd/users/ee993d25324d41da805a9de26430b670/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:19.391971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e5a04266744b9bb76767eb23654cdd, user_id=ee993d25324d41da805a9de26430b670, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:19.394947 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:19.405093 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1318/2619] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:19 2021] PUT /identity/v3/projects/d5e5a04266744b9bb76767eb23654cdd/users/ee993d25324d41da805a9de26430b670/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:19.414846 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81104531-30fd-4a5d-a830-8a5d58046c26 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.415239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81104531-30fd-4a5d-a830-8a5d58046c26 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.415625 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81104531-30fd-4a5d-a830-8a5d58046c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:19.443298 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-81104531-30fd-4a5d-a830-8a5d58046c26 None None] MFA Rules not processed for user `ee993d25324d41da805a9de26430b670`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:19.444519 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-81104531-30fd-4a5d-a830-8a5d58046c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:19.515440 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1302/2620] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:19 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:19.525352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:19.527057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:19.586358 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e384d56-1eba-4a9a-a679-369a8643b581 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:19.589990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:19.590655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.590942 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.591220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:19.600569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:19.601993 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:19.611832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1319/2621] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:19 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:19.970947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81104531-30fd-4a5d-a830-8a5d58046c26 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:19.980636 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81104531-30fd-4a5d-a830-8a5d58046c26 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:19.985049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b4bad-5c7e-4f91-933c-fb7af8288af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:19.985620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4bad-5c7e-4f91-933c-fb7af8288af6 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:19.985904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4bad-5c7e-4f91-933c-fb7af8288af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:19.986333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4bad-5c7e-4f91-933c-fb7af8288af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:20.042139 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b4bad-5c7e-4f91-933c-fb7af8288af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:20.043626 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b4bad-5c7e-4f91-933c-fb7af8288af6 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:20.052892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1303/2622] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:19 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:29.732041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:29.792332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdd2a-bbe7-4fbe-a154-9569e22c756c service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:29.796711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:29.797707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:29.797989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:29.798288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] PATH_INFO: `/v3/users/c59fbb6ae9d142a0b45d3c0e8b246672` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:29.799475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59fbb6ae9d142a0b45d3c0e8b246672)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:29.801376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:29.960737 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59fbb6ae9d142a0b45d3c0e8b246672'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:29.972669 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59fbb6ae9d142a0b45d3c0e8b246672'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:29.973333 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59fbb6ae9d142a0b45d3c0e8b246672'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:29.973928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59fbb6ae9d142a0b45d3c0e8b246672'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:29.980654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59fbb6ae9d142a0b45d3c0e8b246672'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:30.067595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1320/2623] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:29 2021] DELETE /identity/v3/users/c59fbb6ae9d142a0b45d3c0e8b246672 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:30.071942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:30.077137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:30.077137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:30.088892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:30.090064 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:30.146297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1304/2624] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:30.156040 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:30.157406 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:30.213795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec9e4-6ead-455a-9273-5d4f9ece819e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:30.217471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:30.218113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:30.218423 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:30.218862 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:30.227787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:30.229218 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:30.239507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1321/2625] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:30.651803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:30.653227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:30.666557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe966ef-2e6d-49aa-a2f7-3deaae0d4525 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:30.672628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:30.673567 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:30.673866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:30.674165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] PATH_INFO: `/v3/projects/15a8f25f33d041cbaab1d9a18f0acc16` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:30.675605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a8f25f33d041cbaab1d9a18f0acc16)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:30.677813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:30.788640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a8f25f33d041cbaab1d9a18f0acc16', 'request_id': 'req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:30.794122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a8f25f33d041cbaab1d9a18f0acc16', 'request_id': 'req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:30.867632 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a8f25f33d041cbaab1d9a18f0acc16', 'request_id': 'req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:30.879399 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] The token cache is being invalidate because project 15a8f25f33d041cbaab1d9a18f0acc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:30.886042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:30.886042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:30.886042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1305/2626] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:30 2021] DELETE /identity/v3/projects/15a8f25f33d041cbaab1d9a18f0acc16 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:30.886477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:30.896623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222407c6-9e02-4884-bd72-458c59cb4779 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:30.951365 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:30.952226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:30.952514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:30.953313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] PATH_INFO: `/v3/users/ee993d25324d41da805a9de26430b670` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:30.954549 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee993d25324d41da805a9de26430b670)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:30.956497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:31.143597 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee993d25324d41da805a9de26430b670'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.155209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee993d25324d41da805a9de26430b670'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.156467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee993d25324d41da805a9de26430b670'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.157082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee993d25324d41da805a9de26430b670'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.163861 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1308baa5-354d-44b8-8de5-4f72b471c8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee993d25324d41da805a9de26430b670'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.232956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1322/2627] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:30 2021] DELETE /identity/v3/users/ee993d25324d41da805a9de26430b670 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:31.651943 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:31.653430 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:31.666411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1a1e2-7f0e-4e3c-b274-0c4d04329049 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:31.723418 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:31.724198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:31.724481 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:31.724758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] PATH_INFO: `/v3/projects/d5e5a04266744b9bb76767eb23654cdd` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:31.725946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e5a04266744b9bb76767eb23654cdd)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:31.727894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:31.827290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e5a04266744b9bb76767eb23654cdd', 'request_id': 'req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.833394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e5a04266744b9bb76767eb23654cdd', 'request_id': 'req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.896124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e5a04266744b9bb76767eb23654cdd', 'request_id': 'req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.908084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] The token cache is being invalidate because project d5e5a04266744b9bb76767eb23654cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:31.908378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.909005 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8dc3de86-7aa5-4955-84b3-ef30fc641fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:31.910581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1306/2628] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:31 2021] DELETE /identity/v3/projects/d5e5a04266744b9bb76767eb23654cdd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:31.916702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce786d0c-e3e3-4ea1-9949-1407140cb5c6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:31.917185 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce786d0c-e3e3-4ea1-9949-1407140cb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:31.917305 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce786d0c-e3e3-4ea1-9949-1407140cb5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:31.939832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ce786d0c-e3e3-4ea1-9949-1407140cb5c6 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:31.941078 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ce786d0c-e3e3-4ea1-9949-1407140cb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:31.998647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1323/2629] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:32.007926 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b5f5-ab4c-4d64-b5e4-47b833e9e21c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.008215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b5f5-ab4c-4d64-b5e4-47b833e9e21c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.008493 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b5f5-ab4c-4d64-b5e4-47b833e9e21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.026751 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d458b5f5-ab4c-4d64-b5e4-47b833e9e21c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:32.027945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d458b5f5-ab4c-4d64-b5e4-47b833e9e21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:32.036592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1307/2630] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:32.040811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce786d0c-e3e3-4ea1-9949-1407140cb5c6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.051402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce786d0c-e3e3-4ea1-9949-1407140cb5c6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.056133 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.056792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.057080 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.057361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.058105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:41:32.058445 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.060082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.071893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1324/2631] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:41:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:41:32.076234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458b5f5-ab4c-4d64-b5e4-47b833e9e21c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.085684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458b5f5-ab4c-4d64-b5e4-47b833e9e21c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.090306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.090946 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.091228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.091504 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.092211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.094667 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.182438 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1308/2632] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:32 2021] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:32.186581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.196566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fa86-68b9-4133-8a7c-ceb6e2f77011 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.251027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.251640 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.251927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.252201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.252937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.254894 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.351867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1325/2633] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:32 2021] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:41:32.355716 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.366653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609393-c9c3-4ae2-b198-05a600373d4a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.371259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.371919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.372204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.372484 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.373236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.374979 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.386062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1309/2634] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:32.409624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.419657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7ef0e-1189-4102-9f67-928b8fabe1f8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.424499 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbce602-3f68-4a61-8f3a-5237f197300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.425152 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce602-3f68-4a61-8f3a-5237f197300d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.425443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce602-3f68-4a61-8f3a-5237f197300d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.425727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce602-3f68-4a61-8f3a-5237f197300d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.426508 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbce602-3f68-4a61-8f3a-5237f197300d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.428100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbce602-3f68-4a61-8f3a-5237f197300d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.437858 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1326/2635] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:32.442124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.451874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba78fd3-1b68-4545-8b4e-68560551dcd0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.457554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.458451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.458738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.459010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] PATH_INFO: `/v3/projects/565165535f094cb59d0f77323858913a/users/3d2dd46e1e4b47aeaa2249bd89f7e6ce/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.474042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] RBAC: Authorizing `identity:create_grant(project_id=565165535f094cb59d0f77323858913a, user_id=3d2dd46e1e4b47aeaa2249bd89f7e6ce, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.476705 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.539350 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1310/2636] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:32 2021] PUT /identity/v3/projects/565165535f094cb59d0f77323858913a/users/3d2dd46e1e4b47aeaa2249bd89f7e6ce/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:32.550299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6b1a2-78c0-4d08-a7ff-50eb21f1fea6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.550299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6b1a2-78c0-4d08-a7ff-50eb21f1fea6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.550522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6b1a2-78c0-4d08-a7ff-50eb21f1fea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.576520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5ef6b1a2-78c0-4d08-a7ff-50eb21f1fea6 None None] MFA Rules not processed for user `3d2dd46e1e4b47aeaa2249bd89f7e6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:32.578346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5ef6b1a2-78c0-4d08-a7ff-50eb21f1fea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:32.638533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1327/2637] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:32 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:32.643771 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.705189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8491-adb5-4165-bae8-24ade8d6709a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.709907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.710603 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.710875 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.711156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.711868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.713766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.797620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1311/2638] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:32 2021] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:32.801477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6b1a2-78c0-4d08-a7ff-50eb21f1fea6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.812437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6b1a2-78c0-4d08-a7ff-50eb21f1fea6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.864630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.865280 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.865562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.865835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.866571 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.868448 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.951217 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1328/2639] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:32 2021] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:32.952122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.963125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c15e-480e-4d62-8c83-78d990a7bae3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:32.967816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:32.968689 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:32.969053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:32.969339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:32.970084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:32.971717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:32.982031 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1312/2640] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:32.986695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:32.996532 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f9421-2b7d-42dc-ab00-e9a343efa35c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:33.001751 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:33.002682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:33.002940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:33.003335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] PATH_INFO: `/v3/projects/7f916b7a6f104ea2b705950de8a94041/users/517fac3cc4bd44b8a77e9e391a46cf92/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:33.019228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f916b7a6f104ea2b705950de8a94041, user_id=517fac3cc4bd44b8a77e9e391a46cf92, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:33.021926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:33.093725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1329/2641] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:32 2021] PUT /identity/v3/projects/7f916b7a6f104ea2b705950de8a94041/users/517fac3cc4bd44b8a77e9e391a46cf92/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:33.097577 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:33.107333 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d0ad4-6ebf-45ef-be4c-24eaadc2116f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:33.161953 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d89708-f17e-4e51-aaff-7d7828f5f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:33.162641 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89708-f17e-4e51-aaff-7d7828f5f88c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:33.162924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89708-f17e-4e51-aaff-7d7828f5f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:33.163202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d89708-f17e-4e51-aaff-7d7828f5f88c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:33.163947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d89708-f17e-4e51-aaff-7d7828f5f88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:33.165573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d89708-f17e-4e51-aaff-7d7828f5f88c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:33.175766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1313/2642] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:33 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:33.179904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:33.191216 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fb67f-086a-4376-88eb-b851c0786c83 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:33.195932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:33.196795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:33.197082 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:33.197361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] PATH_INFO: `/v3/projects/7f916b7a6f104ea2b705950de8a94041/users/517fac3cc4bd44b8a77e9e391a46cf92/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:33.199372 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f916b7a6f104ea2b705950de8a94041, user_id=517fac3cc4bd44b8a77e9e391a46cf92, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:33.202034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:33.212090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1330/2643] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:33 2021] PUT /identity/v3/projects/7f916b7a6f104ea2b705950de8a94041/users/517fac3cc4bd44b8a77e9e391a46cf92/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:33.222657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd78cc-cd7f-48ef-9953-b20da27e2198 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:33.222951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd78cc-cd7f-48ef-9953-b20da27e2198 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:33.223234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd78cc-cd7f-48ef-9953-b20da27e2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:33.248988 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0fdd78cc-cd7f-48ef-9953-b20da27e2198 None None] MFA Rules not processed for user `517fac3cc4bd44b8a77e9e391a46cf92`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:33.250204 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0fdd78cc-cd7f-48ef-9953-b20da27e2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:33.314653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1314/2644] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:33 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:33.327493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:33.329653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:33.384762 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ae5c2-3b08-4cf4-8a60-d74eea759ce1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:33.388387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:33.389021 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:33.389309 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:33.389591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:33.399624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:33.401044 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:33.411066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1331/2645] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:33 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:33.610780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd78cc-cd7f-48ef-9953-b20da27e2198 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:33.620670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd78cc-cd7f-48ef-9953-b20da27e2198 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:33.624232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47d48a-503b-4122-b4c0-2c57926832b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:33.624861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47d48a-503b-4122-b4c0-2c57926832b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:33.625147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47d48a-503b-4122-b4c0-2c57926832b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:33.625426 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47d48a-503b-4122-b4c0-2c57926832b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:33.681605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47d48a-503b-4122-b4c0-2c57926832b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:33.683057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47d48a-503b-4122-b4c0-2c57926832b0 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:33.692512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1315/2646] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:33 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:40.097653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:40.160095 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791f3b-c989-412e-9cf3-c3e2bb9f3a83 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:40.164998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:40.165863 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:40.166150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:40.166462 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] PATH_INFO: `/v3/users/3d2dd46e1e4b47aeaa2249bd89f7e6ce` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:40.167679 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2dd46e1e4b47aeaa2249bd89f7e6ce)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:40.169599 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:40.359120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2dd46e1e4b47aeaa2249bd89f7e6ce'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:40.371191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2dd46e1e4b47aeaa2249bd89f7e6ce'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:40.371874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2dd46e1e4b47aeaa2249bd89f7e6ce'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:40.372478 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2dd46e1e4b47aeaa2249bd89f7e6ce'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:40.379741 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2dd46e1e4b47aeaa2249bd89f7e6ce'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:40.435720 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1332/2647] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:40 2021] DELETE /identity/v3/users/3d2dd46e1e4b47aeaa2249bd89f7e6ce => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:40.440711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:40.441212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:40.441339 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:40.458486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:40.459718 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:40.517010 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1316/2648] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:40.527127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:40.528525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:40.584924 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8611b2-73c9-43fa-93d1-d5b51d7ad2d9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:40.588568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:40.589207 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:40.589492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:40.589769 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:40.599171 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:40.600610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:40.609801 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1333/2649] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:41.026126 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:41.027601 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:41.040336 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae1f8-f19a-4ec9-8663-10177bdc7742 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:41.045190 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:41.046592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:41.051513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:41.051513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] PATH_INFO: `/v3/projects/565165535f094cb59d0f77323858913a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:41.051513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565165535f094cb59d0f77323858913a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:41.051513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:41.184464 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565165535f094cb59d0f77323858913a', 'request_id': 'req-a407d829-f8f3-4927-84ec-b82a67428452'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.190472 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565165535f094cb59d0f77323858913a', 'request_id': 'req-a407d829-f8f3-4927-84ec-b82a67428452'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.263910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565165535f094cb59d0f77323858913a', 'request_id': 'req-a407d829-f8f3-4927-84ec-b82a67428452'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.276238 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] The token cache is being invalidate because project 565165535f094cb59d0f77323858913a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:41.276460 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.277111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.278669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1317/2650] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:41 2021] DELETE /identity/v3/projects/565165535f094cb59d0f77323858913a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:41.282677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:41.292288 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3a87-7e81-4cca-a16f-1ec0778b33a1 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:41.346281 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:41.347138 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:41.347417 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:41.347690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] PATH_INFO: `/v3/users/517fac3cc4bd44b8a77e9e391a46cf92` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:41.348879 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] RBAC: Authorizing `identity:delete_user(user_id=517fac3cc4bd44b8a77e9e391a46cf92)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:41.350812 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:41.569340 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517fac3cc4bd44b8a77e9e391a46cf92'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.580950 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517fac3cc4bd44b8a77e9e391a46cf92'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.581616 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517fac3cc4bd44b8a77e9e391a46cf92'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.582264 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517fac3cc4bd44b8a77e9e391a46cf92'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.589123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ae570723-596b-46b4-a642-cb69a0cb826c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517fac3cc4bd44b8a77e9e391a46cf92'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:41.651984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1334/2651] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:41 2021] DELETE /identity/v3/users/517fac3cc4bd44b8a77e9e391a46cf92 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:42.077331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:42.079297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:42.092735 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407d829-f8f3-4927-84ec-b82a67428452 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:42.150199 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:42.151051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.151335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.151612 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] PATH_INFO: `/v3/projects/7f916b7a6f104ea2b705950de8a94041` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.152791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f916b7a6f104ea2b705950de8a94041)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:42.154723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:42.316231 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f916b7a6f104ea2b705950de8a94041', 'request_id': 'req-2412f8f1-ec2f-4c2a-a291-0d31c2439423'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:42.321853 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f916b7a6f104ea2b705950de8a94041', 'request_id': 'req-2412f8f1-ec2f-4c2a-a291-0d31c2439423'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:42.384673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f916b7a6f104ea2b705950de8a94041', 'request_id': 'req-2412f8f1-ec2f-4c2a-a291-0d31c2439423'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:42.396802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] The token cache is being invalidate because project 7f916b7a6f104ea2b705950de8a94041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:42.397094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:42.397714 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2412f8f1-ec2f-4c2a-a291-0d31c2439423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:42.399316 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1318/2652] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:42 2021] DELETE /identity/v3/projects/7f916b7a6f104ea2b705950de8a94041 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:42.405038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56137aa-fc38-4984-ba7f-3136f8635c77 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.405534 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56137aa-fc38-4984-ba7f-3136f8635c77 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.405749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56137aa-fc38-4984-ba7f-3136f8635c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.424702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c56137aa-fc38-4984-ba7f-3136f8635c77 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:42.425899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c56137aa-fc38-4984-ba7f-3136f8635c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:42.487354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1335/2653] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:42.495366 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3c77-8fe2-4eab-8e66-d1b212667af0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.495654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3c77-8fe2-4eab-8e66-d1b212667af0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.495933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3c77-8fe2-4eab-8e66-d1b212667af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.515052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4c8a3c77-8fe2-4eab-8e66-d1b212667af0 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:42.516812 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4c8a3c77-8fe2-4eab-8e66-d1b212667af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:42.525669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1319/2654] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:42.529977 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56137aa-fc38-4984-ba7f-3136f8635c77 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:42.541403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56137aa-fc38-4984-ba7f-3136f8635c77 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:42.545205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:42.545891 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.546229 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.546514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.547476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:41:42.547820 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:42.549564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:42.561267 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1336/2655] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:41:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:41:42.566047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3c77-8fe2-4eab-8e66-d1b212667af0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:42.575410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3c77-8fe2-4eab-8e66-d1b212667af0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:42.581040 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:42.581682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.581958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.582267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.582974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:42.584860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:42.699935 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1320/2656] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:42 2021] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:41:42.704828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:42.714927 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f4fdc-085a-434e-955e-626866dd8bb2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:42.773694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:42.774428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.774716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.774995 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.775707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:42.777650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:42.899510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1337/2657] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:42 2021] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:42.903614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:42.913889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb515c9-118d-4e22-a9d7-08454f2d4abd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:42.918706 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:42.919369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.919655 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.922933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.924357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:42.925984 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:42.936589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1321/2658] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:42 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:42.941163 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:42.951126 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a812e-67cf-41be-b9e4-0eb6e7a350e6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:42.956203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a956-35c6-4f37-9561-81b9420f7389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:42.957387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a956-35c6-4f37-9561-81b9420f7389 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.957387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a956-35c6-4f37-9561-81b9420f7389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.957663 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a956-35c6-4f37-9561-81b9420f7389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:42.958258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55a956-35c6-4f37-9561-81b9420f7389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:42.959882 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55a956-35c6-4f37-9561-81b9420f7389 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:42.969964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1338/2659] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:42.974389 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:42.986208 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a249218-a5d6-42e7-ac9c-aaf182f8a475 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:42.990987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:42.991873 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:42.992157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:42.992436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] PATH_INFO: `/v3/projects/ad5a892fd6c8496c99f7f159f4fb6f22/users/ceca9316f07546a18d31e1d5fc093c0d/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.008232 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5a892fd6c8496c99f7f159f4fb6f22, user_id=ceca9316f07546a18d31e1d5fc093c0d, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.010968 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.134290 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1322/2660] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:42 2021] PUT /identity/v3/projects/ad5a892fd6c8496c99f7f159f4fb6f22/users/ceca9316f07546a18d31e1d5fc093c0d/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:43.145523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c9bb-9477-4932-9431-f6d0bfeac933 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.145811 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c9bb-9477-4932-9431-f6d0bfeac933 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.146119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c9bb-9477-4932-9431-f6d0bfeac933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.167148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.168869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:43.173430 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-24c8c9bb-9477-4932-9431-f6d0bfeac933 None None] MFA Rules not processed for user `ceca9316f07546a18d31e1d5fc093c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:43.174637 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-24c8c9bb-9477-4932-9431-f6d0bfeac933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:43.230379 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae85a8-a525-4590-ba97-11b10e75b159 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:43.234019 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:43.234719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.235041 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.235317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.237136 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:43.239316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1339/2661] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:43 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:43.244727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c9bb-9477-4932-9431-f6d0bfeac933 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.302785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.304271 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.307502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c9bb-9477-4932-9431-f6d0bfeac933 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:43.312120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:43.312776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.313665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.320311 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.320465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1323/2662] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:43 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:41:43.320568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.320568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.412269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1340/2663] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:43 2021] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:41:43.413628 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.424515 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613d33-6c06-4cf2-b5b8-cefc49e1f3ce service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:43.480919 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:43.481792 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.482079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.482381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.483103 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.485497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.565486 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1324/2664] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:43 2021] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:43.569689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.580871 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8449314-4f5c-4d31-8052-6b1c0d688f30 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:43.585647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:43.586490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.586846 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.587239 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.588110 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.589876 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.601410 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1341/2665] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:43.605856 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.617838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ae521-4ab6-4c05-97ca-471c0c353c0d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:43.623780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:43.624666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.624990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.625299 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] PATH_INFO: `/v3/projects/e2e8e1d7f3424d3f8026ccc2400e195d/users/26c6459f019045559294d213b99c9794/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.642072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e8e1d7f3424d3f8026ccc2400e195d, user_id=26c6459f019045559294d213b99c9794, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.645042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.745111 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1325/2666] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:43 2021] PUT /identity/v3/projects/e2e8e1d7f3424d3f8026ccc2400e195d/users/26c6459f019045559294d213b99c9794/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:43.749119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.759322 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d187b-5ab3-4a2b-96aa-ab0aa210c42e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:43.818331 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b8c37-e68f-4f79-ab59-ee9dd4d279fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:43.825545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8c37-e68f-4f79-ab59-ee9dd4d279fa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.825545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8c37-e68f-4f79-ab59-ee9dd4d279fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.825545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8c37-e68f-4f79-ab59-ee9dd4d279fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.825545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b8c37-e68f-4f79-ab59-ee9dd4d279fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.825545 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b8c37-e68f-4f79-ab59-ee9dd4d279fa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.837429 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1342/2667] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:43.838681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.849955 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2e7d-8e47-4e9d-96b6-55706b99740a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:43.854725 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:43.855605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.855885 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.856157 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] PATH_INFO: `/v3/projects/e2e8e1d7f3424d3f8026ccc2400e195d/users/26c6459f019045559294d213b99c9794/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.858125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e8e1d7f3424d3f8026ccc2400e195d, user_id=26c6459f019045559294d213b99c9794, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:43.860861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:43.871268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1326/2668] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:43 2021] PUT /identity/v3/projects/e2e8e1d7f3424d3f8026ccc2400e195d/users/26c6459f019045559294d213b99c9794/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:43.882578 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:43.882935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:43.883222 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:43.912323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] MFA Rules not processed for user `26c6459f019045559294d213b99c9794`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:43.913533 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:43.984753 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1343/2669] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:43 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:43.994901 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:43.996615 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:44.054329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7cd9-9cf2-4389-8cea-b326486c24af admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:44.058083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:44.058763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:44.059051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:44.059332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:44.115877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:44.117326 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:44.126909 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1327/2670] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:43 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:46.018345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:46.020345 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:46.087961 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa980f87-add5-46be-ab0a-2094b429c290 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:46.092968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b8a7-a9b1-4dce-af8f-d65871dbdbb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a0c26778994b0c93541400cde47bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:46.093614 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b8a7-a9b1-4dce-af8f-d65871dbdbb8 service placement] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:46.093902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b8a7-a9b1-4dce-af8f-d65871dbdbb8 service placement] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:46.094248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b8a7-a9b1-4dce-af8f-d65871dbdbb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:46.096101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3c39b8a7-a9b1-4dce-af8f-d65871dbdbb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:46.107735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b8a7-a9b1-4dce-af8f-d65871dbdbb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:46.109269 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39b8a7-a9b1-4dce-af8f-d65871dbdbb8 service placement] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:46.120172 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1344/2671] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:47.340859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:47.404785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66239-c3ed-40f2-8442-4fcc5c7d3b20 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:47.410062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:47.410996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:47.415226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:47.415226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] PATH_INFO: `/v3/users/ceca9316f07546a18d31e1d5fc093c0d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:47.415226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceca9316f07546a18d31e1d5fc093c0d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:47.415226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:47.663467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceca9316f07546a18d31e1d5fc093c0d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:47.664116 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceca9316f07546a18d31e1d5fc093c0d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:47.675723 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceca9316f07546a18d31e1d5fc093c0d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:47.677562 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceca9316f07546a18d31e1d5fc093c0d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:47.747614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceca9316f07546a18d31e1d5fc093c0d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:47.761391 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1328/2672] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:47 2021] DELETE /identity/v3/users/ceca9316f07546a18d31e1d5fc093c0d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:47.765840 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:47.766356 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:47.766496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:47.785866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:47.787141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:47.844457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1345/2673] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:41:47.854352 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:47.855745 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:47.914095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a97508-3bab-4bc3-9430-ae38a7d85b61 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:47.917813 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:47.918490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:47.918776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:47.919052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:47.927982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:47.929417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:47.938895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1329/2674] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:41:48.363178 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:48.364566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:48.381933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cf917-b4dd-40fa-8f6d-8f2254bc4125 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:48.387241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:48.388211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:48.393564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:48.397946 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] PATH_INFO: `/v3/projects/ad5a892fd6c8496c99f7f159f4fb6f22` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:48.399501 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5a892fd6c8496c99f7f159f4fb6f22)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:48.401833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:48.514104 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5a892fd6c8496c99f7f159f4fb6f22', 'request_id': 'req-dde0584e-c148-4726-928f-b22093afe022'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.521256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5a892fd6c8496c99f7f159f4fb6f22', 'request_id': 'req-dde0584e-c148-4726-928f-b22093afe022'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.587396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5a892fd6c8496c99f7f159f4fb6f22', 'request_id': 'req-dde0584e-c148-4726-928f-b22093afe022'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.598077 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] The token cache is being invalidate because project ad5a892fd6c8496c99f7f159f4fb6f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:48.598386 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.599013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.600581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1346/2675] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:48 2021] DELETE /identity/v3/projects/ad5a892fd6c8496c99f7f159f4fb6f22 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:48.604740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:48.614332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d501293-ca16-480c-9bd9-6450a6e0ea97 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:48.669880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:48.670768 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:48.671055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:48.671332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] PATH_INFO: `/v3/users/26c6459f019045559294d213b99c9794` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:48.672558 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c6459f019045559294d213b99c9794)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:48.674821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:48.843028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c6459f019045559294d213b99c9794'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.843676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c6459f019045559294d213b99c9794'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.855605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c6459f019045559294d213b99c9794'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.856189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c6459f019045559294d213b99c9794'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.938591 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b4e14f19-1808-4b11-b44e-34c72fcfe2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c6459f019045559294d213b99c9794'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:48.951590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1330/2676] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:48 2021] DELETE /identity/v3/users/26c6459f019045559294d213b99c9794 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:49.380090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:49.381869 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:49.397160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0584e-c148-4726-928f-b22093afe022 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:49.469887 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:49.471830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:49.471830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:49.471830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] PATH_INFO: `/v3/projects/e2e8e1d7f3424d3f8026ccc2400e195d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:49.472933 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e8e1d7f3424d3f8026ccc2400e195d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:49.474905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:49.582907 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e8e1d7f3424d3f8026ccc2400e195d', 'request_id': 'req-2b2f7589-266d-46de-a95e-dbf9eab2063c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:49.589132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e8e1d7f3424d3f8026ccc2400e195d', 'request_id': 'req-2b2f7589-266d-46de-a95e-dbf9eab2063c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:49.676147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e8e1d7f3424d3f8026ccc2400e195d', 'request_id': 'req-2b2f7589-266d-46de-a95e-dbf9eab2063c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:49.686693 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] The token cache is being invalidate because project e2e8e1d7f3424d3f8026ccc2400e195d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:49.693101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:49.693101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-2b2f7589-266d-46de-a95e-dbf9eab2063c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:49.693101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1347/2677] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:49 2021] DELETE /identity/v3/projects/e2e8e1d7f3424d3f8026ccc2400e195d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:49.695424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68602-12eb-4667-a8f9-09769fa36532 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:49.695895 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68602-12eb-4667-a8f9-09769fa36532 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:49.695998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68602-12eb-4667-a8f9-09769fa36532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:49.714086 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-49e68602-12eb-4667-a8f9-09769fa36532 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:49.715248 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-49e68602-12eb-4667-a8f9-09769fa36532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:49.781534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1331/2678] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:49.789705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:49.790006 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:49.790396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:49.811487 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:49.812235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:49.822896 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1348/2679] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:49.827172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e68602-12eb-4667-a8f9-09769fa36532 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:49.830615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:49.831945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:49.836981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e68602-12eb-4667-a8f9-09769fa36532 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:49.841505 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:49.842152 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:49.842468 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:49.842744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:49.843482 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:41:49.843785 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:49.845373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:49.856581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1332/2680] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:41:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:41:49.860778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:49.870961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea5031-d626-4bc6-aa7a-7797d9296932 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:49.877907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:49.878587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:49.878874 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:49.879155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:49.879864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:49.881747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:49.889618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8999d9-223d-4dab-b9dc-7015b8475b1a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:49.893730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:49.894593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:49.894910 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:49.895193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:49.897050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:49.909780 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:49.911252 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:49.920697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1349/2681] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:49.966859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1333/2682] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:41:49 2021] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:41:49.971795 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:49.981325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e183d-7438-4933-a5e2-d6e2dfcbe037 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:50.041928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:50.042628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:50.042960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:50.043246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:50.043974 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:50.045907 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:50.163381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1350/2683] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:41:49 2021] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:41:50.166933 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:50.178465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc863d-38d4-4fd9-99a0-3718e4507b11 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:50.183119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:50.183778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:50.184062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:50.184346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:50.185079 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:50.186713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:50.196650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1334/2684] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:41:50.200713 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:50.210773 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ec412-ee59-486e-a9c5-867cd4cfbcdd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:50.215346 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076f113-79b5-4062-ae46-abf179c7e19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:50.216001 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076f113-79b5-4062-ae46-abf179c7e19d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:50.216283 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076f113-79b5-4062-ae46-abf179c7e19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:50.216557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076f113-79b5-4062-ae46-abf179c7e19d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:50.217352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076f113-79b5-4062-ae46-abf179c7e19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:50.218912 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076f113-79b5-4062-ae46-abf179c7e19d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:50.229443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1351/2685] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:41:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:41:50.233521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:50.243826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea167-5f29-4133-8476-b81199d10967 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:50.248414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:50.249275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:50.249557 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:50.249829 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] PATH_INFO: `/v3/projects/a11d5f8528104d4aa6cd6a4097b19cb2/users/e0d5aa0d35a943a0a970c111ee02a426/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:50.265320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11d5f8528104d4aa6cd6a4097b19cb2, user_id=e0d5aa0d35a943a0a970c111ee02a426, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:50.268966 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:50.334211 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1335/2686] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:41:50 2021] PUT /identity/v3/projects/a11d5f8528104d4aa6cd6a4097b19cb2/users/e0d5aa0d35a943a0a970c111ee02a426/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:50.339308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de792-e1fa-4b1d-aa86-b9f1f14d389c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:50.339631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de792-e1fa-4b1d-aa86-b9f1f14d389c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:50.339914 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de792-e1fa-4b1d-aa86-b9f1f14d389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:50.358889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-911de792-e1fa-4b1d-aa86-b9f1f14d389c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:50.360139 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-911de792-e1fa-4b1d-aa86-b9f1f14d389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:50.429726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1352/2687] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:41:50.441780 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:50.443670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:50.501185 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafa58b-7ecd-4cee-9f81-04b60e6a1449 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:50.506320 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:50.506974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:50.507281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:50.507556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:50.518348 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:50.519877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:50.529477 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1336/2688] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:51.811183 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa88caf-69be-4ffb-a1db-b7ba2711d857 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:51.811787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa88caf-69be-4ffb-a1db-b7ba2711d857 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:51.811787 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa88caf-69be-4ffb-a1db-b7ba2711d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:51.844909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-daa88caf-69be-4ffb-a1db-b7ba2711d857 None None] MFA Rules not processed for user `e0d5aa0d35a943a0a970c111ee02a426`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:51.847298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-daa88caf-69be-4ffb-a1db-b7ba2711d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:51.928334 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1353/2689] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:51 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:51.941369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:51.943097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:52.029274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6acab-5d83-4678-b7d4-2bd4bb525d6e service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:52.034329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:52.035002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:52.038868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:52.039213 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:52.048707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:52.050201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:52.065903 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1337/2690] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:41:51 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:41:53.800521 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5d39d-9e99-4e37-ba36-56699a2a791b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:53.801022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5d39d-9e99-4e37-ba36-56699a2a791b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:53.801140 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5d39d-9e99-4e37-ba36-56699a2a791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:53.819718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1cc5d39d-9e99-4e37-ba36-56699a2a791b None None] MFA Rules not processed for user `e0d5aa0d35a943a0a970c111ee02a426`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:41:53.820940 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1cc5d39d-9e99-4e37-ba36-56699a2a791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:53.827991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1354/2691] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:41:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:41:58.210717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:58.212553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:58.228761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2678b-0749-4433-a7ab-84d0b0f6d752 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:58.233711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:58.234656 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:58.236819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:58.236819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] PATH_INFO: `/v3/users/556ba510e962446888479f57eb098555` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:58.237101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=556ba510e962446888479f57eb098555)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:58.239201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:58.504707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556ba510e962446888479f57eb098555'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:58.505367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556ba510e962446888479f57eb098555'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:58.517279 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556ba510e962446888479f57eb098555'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:58.518549 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556ba510e962446888479f57eb098555'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:58.598985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556ba510e962446888479f57eb098555'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:58.613177 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1338/2692] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:58 2021] DELETE /identity/v3/users/556ba510e962446888479f57eb098555 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:58.857575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5d39d-9e99-4e37-ba36-56699a2a791b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:58.872507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5d39d-9e99-4e37-ba36-56699a2a791b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:58.932208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:58.933223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:58.933509 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:58.933786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] PATH_INFO: `/v3/projects/46c64d4006bf47da9db3f2d198218d91` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:58.935047 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c64d4006bf47da9db3f2d198218d91)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:58.936954 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:59.093192 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c64d4006bf47da9db3f2d198218d91', 'request_id': 'req-507f62fa-3881-46f3-abd8-45964aabf90e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.101102 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c64d4006bf47da9db3f2d198218d91', 'request_id': 'req-507f62fa-3881-46f3-abd8-45964aabf90e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.178834 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c64d4006bf47da9db3f2d198218d91', 'request_id': 'req-507f62fa-3881-46f3-abd8-45964aabf90e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.190272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] The token cache is being invalidate because project 46c64d4006bf47da9db3f2d198218d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:41:59.190557 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.191233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.192835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1355/2693] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:58 2021] DELETE /identity/v3/projects/46c64d4006bf47da9db3f2d198218d91 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:41:59.196766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:59.198222 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:59.211797 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b1db5-cb3f-4e64-8e66-2b5eff07a54e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:41:59.266063 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:41:59.266863 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:41:59.267147 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:41:59.267553 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] PATH_INFO: `/v3/users/58990c542d1644599b1e2a19226903b8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:41:59.269090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58990c542d1644599b1e2a19226903b8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:41:59.271077 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:41:59.467538 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58990c542d1644599b1e2a19226903b8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.468760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58990c542d1644599b1e2a19226903b8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.485198 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58990c542d1644599b1e2a19226903b8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.490417 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58990c542d1644599b1e2a19226903b8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.567228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4f9e7f8b-32c0-465f-9fa0-fa9336500f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58990c542d1644599b1e2a19226903b8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:41:59.582543 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1339/2694] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:41:59 2021] DELETE /identity/v3/users/58990c542d1644599b1e2a19226903b8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:41:59.967818 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:41:59.969393 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:41:59.982707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f62fa-3881-46f3-abd8-45964aabf90e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:42:00.042595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:42:00.043504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:00.043793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:00.044075 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] PATH_INFO: `/v3/projects/ff83b8f40e504e65b721118e313433b4` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:00.045329 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff83b8f40e504e65b721118e313433b4)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:42:00.047360 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:42:00.156873 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff83b8f40e504e65b721118e313433b4', 'request_id': 'req-6660f49c-a93a-4b2c-9555-0ac5b1531414'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:42:00.163692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff83b8f40e504e65b721118e313433b4', 'request_id': 'req-6660f49c-a93a-4b2c-9555-0ac5b1531414'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:42:00.207569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff83b8f40e504e65b721118e313433b4', 'request_id': 'req-6660f49c-a93a-4b2c-9555-0ac5b1531414'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:42:00.218446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] The token cache is being invalidate because project ff83b8f40e504e65b721118e313433b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:42:00.218747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:42:00.219466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:42:00.221678 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1356/2695] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:41:59 2021] DELETE /identity/v3/projects/ff83b8f40e504e65b721118e313433b4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:42:10.090476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:10.091684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:10.092761 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:10.113800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:42:10.115434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:10.181106 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1340/2696] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:42:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:42:10.311900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:42:10.313348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:10.384740 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f49c-a93a-4b2c-9555-0ac5b1531414 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:42:10.389722 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9663ead-0db8-453b-8e52-bb91342e5afb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:42:10.390396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9663ead-0db8-453b-8e52-bb91342e5afb service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:10.390680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9663ead-0db8-453b-8e52-bb91342e5afb service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:10.390960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9663ead-0db8-453b-8e52-bb91342e5afb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:10.400514 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9663ead-0db8-453b-8e52-bb91342e5afb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:42:10.401706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9663ead-0db8-453b-8e52-bb91342e5afb service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:42:10.411968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1357/2697] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:42:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:42:17.218332 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:42:17.220526 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:17.285963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0800d90-8d24-4942-a1c9-6d33a3f8e6e4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:42:17.289811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:42:17.290521 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:17.290810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:17.291089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:17.294494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:17.375490 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:42:17.377738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:42:17.388250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1341/2698] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:42:17 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:42:25.898707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:25.899266 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:25.899361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:25.917025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] MFA Rules not processed for user `9cec710bddca4e6c890c99580d172053`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:42:25.918255 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:25.925754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1358/2699] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:42:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:42:27.711678 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:42:27.713084 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:27.729240 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:42:27.730826 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:27.771682 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65df78-4d41-4033-b919-52bf15199fae service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:42:27.775707 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cafbb-5f94-45c6-8e76-d60333005680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:42:27.776359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cafbb-5f94-45c6-8e76-d60333005680 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:27.776648 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cafbb-5f94-45c6-8e76-d60333005680 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:27.776982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cafbb-5f94-45c6-8e76-d60333005680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:27.778945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9d0cafbb-5f94-45c6-8e76-d60333005680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:27.790922 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318753-855a-43f8-87a4-a87d540a6b56 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:42:27.794620 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d63f82b065248d68fe044e9de8b7b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:42:27.795282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:27.795574 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:27.795872 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:27.797960 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:27.841512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cafbb-5f94-45c6-8e76-d60333005680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:42:27.842982 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cafbb-5f94-45c6-8e76-d60333005680 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:42:27.853049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1342/2700] 10.222.0.11 () {60 vars in 1396 bytes} [Thu Nov 11 16:42:27 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:42:27.861710 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:42:27.863353 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:42:27.873019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1359/2701] 10.222.0.11 () {60 vars in 1396 bytes} [Thu Nov 11 16:42:27 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:42:30.978996 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8076af-a9c2-4ea0-9a26-0584c539de79 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:30.979522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8076af-a9c2-4ea0-9a26-0584c539de79 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:30.979778 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8076af-a9c2-4ea0-9a26-0584c539de79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:30.997837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3e8076af-a9c2-4ea0-9a26-0584c539de79 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:42:30.999083 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3e8076af-a9c2-4ea0-9a26-0584c539de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:31.007006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1343/2702] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:42:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:42:31.020523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:42:31.031959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51ad6-4d87-4fe6-b8b0-01cf05a09b30 service glance] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:42:31.037162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:42:31.037829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:31.038115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:31.038433 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:31.046398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:42:31.047975 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:42:31.056379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1360/2703] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:42:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:42:50.457810 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478f6d-ea80-4934-825b-cbf356beffaf None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:50.458297 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478f6d-ea80-4934-825b-cbf356beffaf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:50.458402 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7478f6d-ea80-4934-825b-cbf356beffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:50.476021 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d7478f6d-ea80-4934-825b-cbf356beffaf None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:42:50.477236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d7478f6d-ea80-4934-825b-cbf356beffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:42:50.485759 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1344/2704] 10.222.0.11 () {58 vars in 967 bytes} [Thu Nov 11 16:42:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:42:50.499439 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:42:50.511606 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68aa80-e158-455c-9a23-286de286b412 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:42:50.517426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:42:50.518101 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:42:50.518437 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:42:50.518983 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:42:50.527875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:42:50.529465 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:42:50.538136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1361/2705] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:42:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:43:22.226439 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:22.226937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:22.227749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:22.245140 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] MFA Rules not processed for user `e0d5aa0d35a943a0a970c111ee02a426`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:22.246400 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:22.298822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1345/2706] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:22 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:40.373449 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:40.374874 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:40.386793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def7c84-57fb-4aa0-aebe-507f0e48c9c1 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:40.390330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:40.390991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:40.391278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:40.391558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:40.393525 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:40.455228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:40.456659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:40.466564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1362/2707] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:43:44.103754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:44.105300 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:44.120711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75577-9bd5-46c2-a811-6a122c398fc0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:44.125775 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:44.126677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:44.126963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:44.127243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] PATH_INFO: `/v3/users/98f235f4cb944eb6926375e2bb551741` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:44.128592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f235f4cb944eb6926375e2bb551741)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:44.130555 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:44.343137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f235f4cb944eb6926375e2bb551741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.343793 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f235f4cb944eb6926375e2bb551741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.355681 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f235f4cb944eb6926375e2bb551741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.356434 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f235f4cb944eb6926375e2bb551741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.432359 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0cc8f5b6-d0d1-4fbc-884a-7acf978cbe40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f235f4cb944eb6926375e2bb551741'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.444878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1346/2708] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:43:44 2021] DELETE /identity/v3/users/98f235f4cb944eb6926375e2bb551741 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:44.693017 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:44.702936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951305-5a58-4c7a-864a-b1193319ef79 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:44.758641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:44.759588 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:44.759979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:44.760323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] PATH_INFO: `/v3/projects/879f0a1ecdb7480b90d97e4531b9ff6d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:44.761643 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] RBAC: Authorizing `identity:delete_project(project_id=879f0a1ecdb7480b90d97e4531b9ff6d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:44.763610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:44.878732 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879f0a1ecdb7480b90d97e4531b9ff6d', 'request_id': 'req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.887195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879f0a1ecdb7480b90d97e4531b9ff6d', 'request_id': 'req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.949198 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879f0a1ecdb7480b90d97e4531b9ff6d', 'request_id': 'req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.959936 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] The token cache is being invalidate because project 879f0a1ecdb7480b90d97e4531b9ff6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:43:44.960279 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.960941 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5453203d-1f6a-4bf0-b01a-e4dffc3c099e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:44.963284 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1363/2709] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:43:44 2021] DELETE /identity/v3/projects/879f0a1ecdb7480b90d97e4531b9ff6d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:44.969008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf79c-ed7f-4188-a3ca-4b6ae68cdcfc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:44.974050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf79c-ed7f-4188-a3ca-4b6ae68cdcfc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:44.974050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf79c-ed7f-4188-a3ca-4b6ae68cdcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:44.987346 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d8fdf79c-ed7f-4188-a3ca-4b6ae68cdcfc None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:44.988532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d8fdf79c-ed7f-4188-a3ca-4b6ae68cdcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:45.047265 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1347/2710] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:45.060764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3964c9-1c97-4d25-bfcc-ab84060e2723 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.061055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3964c9-1c97-4d25-bfcc-ab84060e2723 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.061332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3964c9-1c97-4d25-bfcc-ab84060e2723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.079870 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8d3964c9-1c97-4d25-bfcc-ab84060e2723 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:45.081067 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8d3964c9-1c97-4d25-bfcc-ab84060e2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:45.089956 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1364/2711] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:45.094343 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf79c-ed7f-4188-a3ca-4b6ae68cdcfc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.104673 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf79c-ed7f-4188-a3ca-4b6ae68cdcfc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.109205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.109842 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.110122 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.110431 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.111165 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:43:45.111467 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.113052 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:45.124317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1348/2712] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:43:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:43:45.128494 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3964c9-1c97-4d25-bfcc-ab84060e2723 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.137656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3964c9-1c97-4d25-bfcc-ab84060e2723 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.142317 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.143225 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.143511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.143786 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.144507 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.146481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:45.253135 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1365/2713] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:43:45 2021] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:43:45.257228 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.268006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389f20a-84a6-4771-a071-d94e11e4417b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.321203 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.322429 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.322803 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.323115 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.323814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.325730 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:45.429499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1349/2714] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:43:45 2021] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:43:45.440964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.451937 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6702d9-858a-4e59-9829-4630fc63fa25 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.456558 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.457209 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.457488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.457764 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.458554 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.460154 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:45.471551 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1366/2715] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:45.475478 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.485347 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c61d-76a8-46f6-a73b-96528ebf6dde admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.490088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c15eb-4b7c-4b2d-aacf-b3d8f076e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.490767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c15eb-4b7c-4b2d-aacf-b3d8f076e1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.491056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c15eb-4b7c-4b2d-aacf-b3d8f076e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.491337 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c15eb-4b7c-4b2d-aacf-b3d8f076e1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.492075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c15eb-4b7c-4b2d-aacf-b3d8f076e1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.493675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c15eb-4b7c-4b2d-aacf-b3d8f076e1a9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:45.503580 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1350/2716] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:45 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:45.507402 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.518792 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1c059-fd0c-42db-a463-43c93c88cc4b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.523552 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.524416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.524701 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.524997 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] PATH_INFO: `/v3/projects/5e9102b29b344f41b58080349d261424/users/146473f5d30a443d90e1b10867f0dc6f/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.540491 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9102b29b344f41b58080349d261424, user_id=146473f5d30a443d90e1b10867f0dc6f, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.543296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:45.632189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1367/2717] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:43:45 2021] PUT /identity/v3/projects/5e9102b29b344f41b58080349d261424/users/146473f5d30a443d90e1b10867f0dc6f/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:45.644866 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa1c0f-a35f-4d09-bc66-55d1f8860620 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.645181 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa1c0f-a35f-4d09-bc66-55d1f8860620 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.645500 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa1c0f-a35f-4d09-bc66-55d1f8860620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.673262 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a3aa1c0f-a35f-4d09-bc66-55d1f8860620 None None] MFA Rules not processed for user `146473f5d30a443d90e1b10867f0dc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:45.674599 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a3aa1c0f-a35f-4d09-bc66-55d1f8860620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:45.737341 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1351/2718] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:45 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:45.741844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.803296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653681-2173-4995-a43d-41f8995ef910 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.808261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.808905 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.809186 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.809460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.810170 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.812083 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:45.890293 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1368/2719] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:43:45 2021] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:43:45.894744 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa1c0f-a35f-4d09-bc66-55d1f8860620 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:45.905963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa1c0f-a35f-4d09-bc66-55d1f8860620 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:45.959762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:45.960428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:45.960713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:45.960987 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:45.961719 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:45.964799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:46.083914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1352/2720] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:43:45 2021] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:43:46.088366 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:46.098392 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c4e9e-8e24-4b0b-ac97-3c50156fbfa3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:46.103023 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:46.104859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:46.104859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:46.104859 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:46.105127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:46.106674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:46.117022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1369/2721] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:46.121358 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:46.131484 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0108b1-d34a-4835-a4b3-94d2fb510c02 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:46.136724 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:46.137587 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:46.137872 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:46.138150 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] PATH_INFO: `/v3/projects/56dcff717c21420fb5157729831c2361/users/3c4e3333d9f2472e8d93515829db09e0/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:46.153380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dcff717c21420fb5157729831c2361, user_id=3c4e3333d9f2472e8d93515829db09e0, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:46.156056 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:46.228444 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1353/2722] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:43:46 2021] PUT /identity/v3/projects/56dcff717c21420fb5157729831c2361/users/3c4e3333d9f2472e8d93515829db09e0/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:46.233085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:46.243048 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c76b-bb8e-4868-81fb-f549f3d7b76c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:46.297583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39059479-cb40-4116-847e-7b2b86a35794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:46.298272 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059479-cb40-4116-847e-7b2b86a35794 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:46.298564 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059479-cb40-4116-847e-7b2b86a35794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:46.298845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39059479-cb40-4116-847e-7b2b86a35794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:46.299589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39059479-cb40-4116-847e-7b2b86a35794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:46.301184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39059479-cb40-4116-847e-7b2b86a35794 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:46.311421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1370/2723] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:46 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:46.315695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:46.326537 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e464b21-843f-4f4d-885b-902c8e47a5fd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:46.331151 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:46.334321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:46.334321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:46.334321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] PATH_INFO: `/v3/projects/56dcff717c21420fb5157729831c2361/users/3c4e3333d9f2472e8d93515829db09e0/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:46.334644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dcff717c21420fb5157729831c2361, user_id=3c4e3333d9f2472e8d93515829db09e0, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:46.337237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:46.347433 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1354/2724] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:43:46 2021] PUT /identity/v3/projects/56dcff717c21420fb5157729831c2361/users/3c4e3333d9f2472e8d93515829db09e0/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:46.357742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:46.359506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:46.359506 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:46.384866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] MFA Rules not processed for user `3c4e3333d9f2472e8d93515829db09e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:46.386706 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:46.454034 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1371/2725] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:46 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:46.464283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:46.465972 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:46.520554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c3f09-81d1-4479-ad86-352099b55bed admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:46.524173 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:46.524806 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:46.525090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:46.525368 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:46.534950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:46.536312 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:46.546660 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1355/2726] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:46 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:43:46.588247 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:46.590141 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:46.601703 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ec003-f858-4c6e-b5a1-f0ceaa688c48 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:46.606028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb16e9-a515-4b70-8c35-0fa4e055ae6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:46.606690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb16e9-a515-4b70-8c35-0fa4e055ae6f service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:46.606971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb16e9-a515-4b70-8c35-0fa4e055ae6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:46.607245 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb16e9-a515-4b70-8c35-0fa4e055ae6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:46.660191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb16e9-a515-4b70-8c35-0fa4e055ae6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:46.661615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb16e9-a515-4b70-8c35-0fa4e055ae6f service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:46.671694 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1372/2727] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:46 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:43:53.484062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:53.547585 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c358f-7c62-4ecb-b336-17d674d9cabb service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:53.552401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:53.553256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:53.553539 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:53.553819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] PATH_INFO: `/v3/users/146473f5d30a443d90e1b10867f0dc6f` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:53.555069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=146473f5d30a443d90e1b10867f0dc6f)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:53.557028 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:53.750428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146473f5d30a443d90e1b10867f0dc6f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:53.751022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146473f5d30a443d90e1b10867f0dc6f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:53.762571 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146473f5d30a443d90e1b10867f0dc6f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:53.764814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146473f5d30a443d90e1b10867f0dc6f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:53.857940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146473f5d30a443d90e1b10867f0dc6f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:53.870576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1356/2728] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:43:53 2021] DELETE /identity/v3/users/146473f5d30a443d90e1b10867f0dc6f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:53.875435 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:53.875923 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:53.876028 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:53.894958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:53.896157 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:53.953806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1373/2729] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:43:53.964351 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:53.965739 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:54.027957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c40a8-02a0-4b65-af9d-d754476236dc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:54.034051 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:54.039466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:54.039466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:54.039466 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:54.046270 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:54.047734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:54.059202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1357/2730] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:43:54.617227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:54.624471 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:54.633629 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772ec7f-4b75-4a81-95f3-bdded102a1de None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:54.641636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:54.643830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:54.644090 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:54.644515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] PATH_INFO: `/v3/projects/5e9102b29b344f41b58080349d261424` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:54.645848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9102b29b344f41b58080349d261424)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:54.647677 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:54.762019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9102b29b344f41b58080349d261424', 'request_id': 'req-12c71e3c-8e2e-4e55-96a2-a331151096d0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:54.768344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9102b29b344f41b58080349d261424', 'request_id': 'req-12c71e3c-8e2e-4e55-96a2-a331151096d0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:54.843389 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9102b29b344f41b58080349d261424', 'request_id': 'req-12c71e3c-8e2e-4e55-96a2-a331151096d0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:54.854151 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] The token cache is being invalidate because project 5e9102b29b344f41b58080349d261424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:43:54.854493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:54.855105 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:54.856627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1374/2731] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:43:54 2021] DELETE /identity/v3/projects/5e9102b29b344f41b58080349d261424 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:43:54.860605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:54.870293 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383244b-f8c5-4851-b09d-9ebbc1fab287 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:54.925428 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:54.926319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:54.926606 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:54.926890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] PATH_INFO: `/v3/users/3c4e3333d9f2472e8d93515829db09e0` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:54.928094 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4e3333d9f2472e8d93515829db09e0)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:54.930004 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:55.194227 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4e3333d9f2472e8d93515829db09e0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.194890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4e3333d9f2472e8d93515829db09e0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.206595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4e3333d9f2472e8d93515829db09e0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.207221 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4e3333d9f2472e8d93515829db09e0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.294891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-dac20335-ffcc-4296-91db-bcf0bf86c614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4e3333d9f2472e8d93515829db09e0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.307149 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1358/2732] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:43:54 2021] DELETE /identity/v3/users/3c4e3333d9f2472e8d93515829db09e0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:55.713617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:55.713617 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:55.722237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c71e3c-8e2e-4e55-96a2-a331151096d0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:55.777441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:55.778326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:55.778615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:55.779492 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] PATH_INFO: `/v3/projects/56dcff717c21420fb5157729831c2361` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:55.780760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56dcff717c21420fb5157729831c2361)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:55.782711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:55.891631 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56dcff717c21420fb5157729831c2361', 'request_id': 'req-c6b1006f-f2a4-4061-ad75-e5469b2b2295'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.897988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56dcff717c21420fb5157729831c2361', 'request_id': 'req-c6b1006f-f2a4-4061-ad75-e5469b2b2295'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.986234 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56dcff717c21420fb5157729831c2361', 'request_id': 'req-c6b1006f-f2a4-4061-ad75-e5469b2b2295'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.996911 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] The token cache is being invalidate because project 56dcff717c21420fb5157729831c2361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:43:55.997206 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.998421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c6b1006f-f2a4-4061-ad75-e5469b2b2295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:55.999985 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1375/2733] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:43:55 2021] DELETE /identity/v3/projects/56dcff717c21420fb5157729831c2361 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:56.005839 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479bc9b-f00d-41e8-9b4a-9ecaaf59afda None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.006321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479bc9b-f00d-41e8-9b4a-9ecaaf59afda None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.006436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479bc9b-f00d-41e8-9b4a-9ecaaf59afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.024715 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9479bc9b-f00d-41e8-9b4a-9ecaaf59afda None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:56.025915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9479bc9b-f00d-41e8-9b4a-9ecaaf59afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:56.084410 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1359/2734] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:56.093030 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc625c-3dd9-4ee0-992d-bb356e21f145 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.093326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc625c-3dd9-4ee0-992d-bb356e21f145 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.093630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc625c-3dd9-4ee0-992d-bb356e21f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.112432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c8fc625c-3dd9-4ee0-992d-bb356e21f145 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:56.113628 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c8fc625c-3dd9-4ee0-992d-bb356e21f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:56.121754 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1376/2735] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:56.126605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479bc9b-f00d-41e8-9b4a-9ecaaf59afda None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.136044 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479bc9b-f00d-41e8-9b4a-9ecaaf59afda None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.141321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.141959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.142266 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.142799 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.143530 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:43:56.143837 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.145419 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.156688 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1360/2736] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:43:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:43:56.161498 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc625c-3dd9-4ee0-992d-bb356e21f145 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.170881 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc625c-3dd9-4ee0-992d-bb356e21f145 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.175592 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.176236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.176522 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.176803 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.177511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.179455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.256314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1377/2737] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:43:56 2021] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:43:56.260275 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.271162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0819b9c-fb7e-4cbf-ac82-ea613cafef39 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.327654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.328324 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.328610 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.328889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.329600 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.331699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.452906 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1361/2738] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:43:56 2021] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:43:56.456848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.467593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3c01-48d4-4200-b915-ab5b3767003b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.472112 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.472772 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.473074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.473352 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.474088 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.475695 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.486055 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1378/2739] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:56.489950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.500054 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e811639-ccae-4194-95fc-3ba88fac0831 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.504713 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.505362 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.505649 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.505930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.506766 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.508325 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.518958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1362/2740] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:56.522828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.532867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f661b-8354-441b-a1df-d6f3a96e2c5b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.539233 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d36e4-d86d-4b4f-aee6-8fb187041857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.540111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d36e4-d86d-4b4f-aee6-8fb187041857 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.540452 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d36e4-d86d-4b4f-aee6-8fb187041857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.540728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d36e4-d86d-4b4f-aee6-8fb187041857 admin admin] PATH_INFO: `/v3/projects/f82444b525f84c2696bb5988c696d29c/users/2f935ae01de147cea27dab5ca4976b67/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.555205 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d36e4-d86d-4b4f-aee6-8fb187041857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82444b525f84c2696bb5988c696d29c, user_id=2f935ae01de147cea27dab5ca4976b67, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.557822 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d36e4-d86d-4b4f-aee6-8fb187041857 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.628782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.630528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:56.665867 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1379/2741] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:43:56 2021] PUT /identity/v3/projects/f82444b525f84c2696bb5988c696d29c/users/2f935ae01de147cea27dab5ca4976b67/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:43:56.677313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6d53-9355-4627-9b00-c314adbec772 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.677615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6d53-9355-4627-9b00-c314adbec772 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.677898 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6d53-9355-4627-9b00-c314adbec772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.687774 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78e37f-cc9f-4c2b-94e4-c0345ad65b78 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.704403 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-02aa6d53-9355-4627-9b00-c314adbec772 None None] MFA Rules not processed for user `2f935ae01de147cea27dab5ca4976b67`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:56.705638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-02aa6d53-9355-4627-9b00-c314adbec772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:56.736202 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.736845 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.737129 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.737409 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.742572 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:56.769412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1380/2742] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:56 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:43:56.773685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa6d53-9355-4627-9b00-c314adbec772 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.813176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.814653 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.825378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1363/2743] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:43:56.838291 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa6d53-9355-4627-9b00-c314adbec772 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:56.843192 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:56.843844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:56.844124 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:56.844396 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:56.845103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:56.847038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:56.949976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1381/2744] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:43:56 2021] POST /identity/v3/projects => generated 389 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:43:56.954690 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:56.964791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c95c8-3517-4ce2-b000-8fcd4970db2f service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:57.020731 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:57.021381 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.021613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.021892 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.022640 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:57.024593 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:57.130187 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1364/2745] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:43:56 2021] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:43:57.134117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:57.144852 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5684a2-ad50-44b1-b74b-130ec7fec9f2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:57.150515 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:57.151219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.151467 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.151746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.152496 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:57.154273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:57.166510 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1382/2746] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:57.171758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:57.182353 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5053286-a8e3-42ca-8112-a632e3499602 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:57.187952 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:57.188830 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.191303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.191303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] PATH_INFO: `/v3/projects/94d0e1bf6aa847cc8f894b87d687a363/users/a14c3c231c2f4c81be7b06feb2d20c31/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.204127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d0e1bf6aa847cc8f894b87d687a363, user_id=a14c3c231c2f4c81be7b06feb2d20c31, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:57.206758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:57.289841 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1365/2747] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:43:57 2021] PUT /identity/v3/projects/94d0e1bf6aa847cc8f894b87d687a363/users/a14c3c231c2f4c81be7b06feb2d20c31/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:57.293696 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:57.304428 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73093f2-55dd-4f9c-9973-9b7ebcf92575 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:57.361500 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54ad85-5dc3-42d3-96b8-54d13e2d86b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:57.362160 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54ad85-5dc3-42d3-96b8-54d13e2d86b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.362623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54ad85-5dc3-42d3-96b8-54d13e2d86b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.362903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54ad85-5dc3-42d3-96b8-54d13e2d86b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.363636 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54ad85-5dc3-42d3-96b8-54d13e2d86b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:57.365199 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54ad85-5dc3-42d3-96b8-54d13e2d86b9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:57.375419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1383/2748] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:43:57 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:43:57.379576 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:57.390361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d2e8f-d017-4c0a-bcc4-fd45563e494b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:57.395317 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:57.396264 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.396545 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.396822 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] PATH_INFO: `/v3/projects/94d0e1bf6aa847cc8f894b87d687a363/users/a14c3c231c2f4c81be7b06feb2d20c31/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.398900 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d0e1bf6aa847cc8f894b87d687a363, user_id=a14c3c231c2f4c81be7b06feb2d20c31, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:57.401514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:57.412095 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1366/2749] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:43:57 2021] PUT /identity/v3/projects/94d0e1bf6aa847cc8f894b87d687a363/users/a14c3c231c2f4c81be7b06feb2d20c31/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:57.422050 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0828d-42fe-4fab-b063-a4404fc64361 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.422373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0828d-42fe-4fab-b063-a4404fc64361 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.422655 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0828d-42fe-4fab-b063-a4404fc64361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.449203 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f7e0828d-42fe-4fab-b063-a4404fc64361 None None] MFA Rules not processed for user `a14c3c231c2f4c81be7b06feb2d20c31`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:57.450421 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f7e0828d-42fe-4fab-b063-a4404fc64361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:57.515434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1384/2750] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:57 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:57.525369 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:57.527118 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:57.583658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9381f5e-e480-451e-be0c-1ced975e2c63 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:57.587321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c3791-ef43-4114-98e4-b69363a58a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:57.587956 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c3791-ef43-4114-98e4-b69363a58a93 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.588241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c3791-ef43-4114-98e4-b69363a58a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.588522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c3791-ef43-4114-98e4-b69363a58a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.597315 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c3791-ef43-4114-98e4-b69363a58a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:57.598782 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c3791-ef43-4114-98e4-b69363a58a93 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:57.607969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1367/2751] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:57 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:43:57.727344 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0828d-42fe-4fab-b063-a4404fc64361 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:57.788426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0828d-42fe-4fab-b063-a4404fc64361 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:57.793039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:57.793908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:57.794219 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:57.794595 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] PATH_INFO: `/v3/users/2f935ae01de147cea27dab5ca4976b67` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:57.795796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f935ae01de147cea27dab5ca4976b67)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:57.797717 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:58.007929 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f935ae01de147cea27dab5ca4976b67'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:58.020120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f935ae01de147cea27dab5ca4976b67'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:58.020785 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f935ae01de147cea27dab5ca4976b67'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:58.021519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f935ae01de147cea27dab5ca4976b67'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:58.028450 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f935ae01de147cea27dab5ca4976b67'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:58.154426 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1385/2752] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:43:57 2021] DELETE /identity/v3/users/2f935ae01de147cea27dab5ca4976b67 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:58.159670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:58.160134 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:58.160246 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:58.177664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:43:58.178888 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:58.241820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1368/2753] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:43:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:43:58.253241 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:58.254779 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:58.315654 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607f375-f00b-4c3e-a6e8-7cbd63b5a00a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:58.319302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:58.320011 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:58.320298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:58.320576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:58.329644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:58.331125 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:58.340799 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1386/2754] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:43:58.802240 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:58.803658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:58.815401 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fb5a0-cd9c-49e7-b6aa-03f4509af4eb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:58.820050 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:58.820891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:58.821172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:58.821445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] PATH_INFO: `/v3/projects/f82444b525f84c2696bb5988c696d29c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:58.822671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82444b525f84c2696bb5988c696d29c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:58.824590 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:58.980274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82444b525f84c2696bb5988c696d29c', 'request_id': 'req-6cbc91ad-574d-4fb5-a869-18a0e237a43a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:58.985524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82444b525f84c2696bb5988c696d29c', 'request_id': 'req-6cbc91ad-574d-4fb5-a869-18a0e237a43a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.102548 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82444b525f84c2696bb5988c696d29c', 'request_id': 'req-6cbc91ad-574d-4fb5-a869-18a0e237a43a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.114245 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] The token cache is being invalidate because project f82444b525f84c2696bb5988c696d29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:43:59.114532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.115168 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.116677 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1369/2755] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:43:58 2021] DELETE /identity/v3/projects/f82444b525f84c2696bb5988c696d29c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:59.120800 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:59.130422 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2b17a-8802-4ace-adc0-7b81786ae7bc service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:59.186837 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:59.187704 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:59.187992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:59.188273 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] PATH_INFO: `/v3/users/a14c3c231c2f4c81be7b06feb2d20c31` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:59.189485 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14c3c231c2f4c81be7b06feb2d20c31)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:43:59.191483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:43:59.424058 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14c3c231c2f4c81be7b06feb2d20c31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.435323 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14c3c231c2f4c81be7b06feb2d20c31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.435988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14c3c231c2f4c81be7b06feb2d20c31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.437123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14c3c231c2f4c81be7b06feb2d20c31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.445113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14c3c231c2f4c81be7b06feb2d20c31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:43:59.542809 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1387/2756] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:43:59 2021] DELETE /identity/v3/users/a14c3c231c2f4c81be7b06feb2d20c31 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:43:59.821945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:43:59.823396 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:59.880135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc91ad-574d-4fb5-a869-18a0e237a43a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:43:59.927760 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e974c-7036-4349-bab7-b6253f6f351f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:43:59.930137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e974c-7036-4349-bab7-b6253f6f351f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:43:59.930137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e974c-7036-4349-bab7-b6253f6f351f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:43:59.930137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e974c-7036-4349-bab7-b6253f6f351f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:43:59.930820 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ff7e974c-7036-4349-bab7-b6253f6f351f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:43:59.999828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e974c-7036-4349-bab7-b6253f6f351f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.001268 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e974c-7036-4349-bab7-b6253f6f351f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:00.016047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1370/2757] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:43:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:00.055130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:00.055130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:00.122567 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cd708-8c91-4de1-8260-675693ea6aab admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:00.128727 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:00.129589 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.129884 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.130167 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] PATH_INFO: `/v3/projects/94d0e1bf6aa847cc8f894b87d687a363` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.131420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d0e1bf6aa847cc8f894b87d687a363)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.133335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:00.251949 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d0e1bf6aa847cc8f894b87d687a363', 'request_id': 'req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:00.258497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d0e1bf6aa847cc8f894b87d687a363', 'request_id': 'req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:00.360586 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d0e1bf6aa847cc8f894b87d687a363', 'request_id': 'req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:00.370860 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] The token cache is being invalidate because project 94d0e1bf6aa847cc8f894b87d687a363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:00.371638 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:00.371790 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7d1ff49e-8fb6-46ca-8d58-2e62d82d5728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:00.373361 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1388/2758] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:00 2021] DELETE /identity/v3/projects/94d0e1bf6aa847cc8f894b87d687a363 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:00.379282 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754165c-2570-4946-bd87-4e553dd35d22 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.379694 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754165c-2570-4946-bd87-4e553dd35d22 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.379975 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754165c-2570-4946-bd87-4e553dd35d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.397786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6754165c-2570-4946-bd87-4e553dd35d22 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:00.399036 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6754165c-2570-4946-bd87-4e553dd35d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:00.456821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1371/2759] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:00.464829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50f4a-6cdf-467d-b10c-82a3eed3d855 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.465123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50f4a-6cdf-467d-b10c-82a3eed3d855 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.468932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50f4a-6cdf-467d-b10c-82a3eed3d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.484227 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a3a50f4a-6cdf-467d-b10c-82a3eed3d855 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:00.485419 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a3a50f4a-6cdf-467d-b10c-82a3eed3d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:00.493327 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1389/2760] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:00.506380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754165c-2570-4946-bd87-4e553dd35d22 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:00.516861 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754165c-2570-4946-bd87-4e553dd35d22 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:00.521709 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:00.522386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.522666 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.522940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.523671 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:44:00.523976 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.525559 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:00.541568 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1372/2761] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:44:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:44:00.542756 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50f4a-6cdf-467d-b10c-82a3eed3d855 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:00.552037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50f4a-6cdf-467d-b10c-82a3eed3d855 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:00.556925 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:00.557568 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.557850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.558128 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.558899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.560794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:00.672743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1390/2762] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:44:00 2021] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:00.676740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:00.686650 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a1310-096a-4c01-b5d3-23d1c61b8d53 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:00.741189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:00.741878 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.742163 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.742483 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.743170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.745081 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:00.840006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1373/2763] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:44:00 2021] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:00.844776 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:00.855086 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdc7e4-7365-4cdc-bcde-13f1abf08d61 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:00.859757 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:00.860418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.860827 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.861113 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.861976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.863624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:00.874547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1391/2764] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:00.878685 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:00.888501 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3fb04-c0ff-47c2-8b8e-1fc88c94f21c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:00.893930 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8df02-e691-408a-be91-7f3f117f9d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:00.894609 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8df02-e691-408a-be91-7f3f117f9d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.894896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8df02-e691-408a-be91-7f3f117f9d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.895234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8df02-e691-408a-be91-7f3f117f9d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.896002 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8df02-e691-408a-be91-7f3f117f9d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.897586 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8df02-e691-408a-be91-7f3f117f9d72 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:00.907306 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1374/2765] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:00.911415 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:00.921296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b2bfc-31b6-4aca-91cd-435b77c514ac admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:00.926069 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:00.926909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:00.927197 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:00.927476 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] PATH_INFO: `/v3/projects/3ea3f20144fc46a59953f43449a6cf40/users/c448e8353e45413cbbdc878e817094bd/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:00.943646 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea3f20144fc46a59953f43449a6cf40, user_id=c448e8353e45413cbbdc878e817094bd, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:00.946376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.069042 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1392/2766] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:00 2021] PUT /identity/v3/projects/3ea3f20144fc46a59953f43449a6cf40/users/c448e8353e45413cbbdc878e817094bd/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:01.079740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102977-3d08-40db-9168-625c36f27555 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.080075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102977-3d08-40db-9168-625c36f27555 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.080355 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102977-3d08-40db-9168-625c36f27555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.106710 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-26102977-3d08-40db-9168-625c36f27555 None None] MFA Rules not processed for user `c448e8353e45413cbbdc878e817094bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:01.107918 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-26102977-3d08-40db-9168-625c36f27555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:01.176435 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1375/2767] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:01 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:01.180892 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.243488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e72239-901e-41aa-9885-7de87d1c1a23 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:01.248115 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:01.248763 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.249675 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.249900 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.250610 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:01.252483 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.349973 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1393/2768] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:44:01 2021] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:01.353971 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26102977-3d08-40db-9168-625c36f27555 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.365767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26102977-3d08-40db-9168-625c36f27555 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:01.425075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:01.425380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.425783 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.426062 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.426862 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:01.429009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.578082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1376/2769] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:44:01 2021] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:01.582468 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.592480 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa916202-ff41-447a-9ce8-f9d610434abc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:01.597418 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:01.598084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.598405 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.598707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.599458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:01.601066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.611889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1394/2770] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:01.616008 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.626974 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf11583-097d-4b4b-be60-91f657ac6b64 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:01.632017 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:01.632608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.632893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.633171 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] PATH_INFO: `/v3/projects/db413574480d45d19e72b90c9eb7466c/users/d7dd13d1c9594591bf8d4ca511f39113/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.648631 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db413574480d45d19e72b90c9eb7466c, user_id=d7dd13d1c9594591bf8d4ca511f39113, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:01.651314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.737816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1377/2771] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:01 2021] PUT /identity/v3/projects/db413574480d45d19e72b90c9eb7466c/users/d7dd13d1c9594591bf8d4ca511f39113/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:01.741806 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.752926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353040ef-228a-4586-a48d-6a4e909fa316 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:01.787801 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.789527 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:01.811117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:01.812671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.812962 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.813236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.813980 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:01.815609 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.825296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1395/2772] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:01 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:01.838735 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.839955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74791b28-2ce7-4412-a54f-b781a49e56cc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:01.845165 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69b756-614e-4ed8-b3dd-0e3d3d75bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:01.846147 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69b756-614e-4ed8-b3dd-0e3d3d75bf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.846477 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69b756-614e-4ed8-b3dd-0e3d3d75bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.846743 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69b756-614e-4ed8-b3dd-0e3d3d75bf41 admin admin] PATH_INFO: `/v3/projects/db413574480d45d19e72b90c9eb7466c/users/d7dd13d1c9594591bf8d4ca511f39113/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.848794 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69b756-614e-4ed8-b3dd-0e3d3d75bf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db413574480d45d19e72b90c9eb7466c, user_id=d7dd13d1c9594591bf8d4ca511f39113, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:01.851504 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69b756-614e-4ed8-b3dd-0e3d3d75bf41 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.862683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1396/2773] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:01 2021] PUT /identity/v3/projects/db413574480d45d19e72b90c9eb7466c/users/d7dd13d1c9594591bf8d4ca511f39113/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:01.866896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766c696-e26b-44c5-8681-1de080d7d22f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:01.877633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4b0c-13a3-40ea-ad79-1afa4aaa6366 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.878232 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4b0c-13a3-40ea-ad79-1afa4aaa6366 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.878532 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db4b0c-13a3-40ea-ad79-1afa4aaa6366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.907626 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c7db4b0c-13a3-40ea-ad79-1afa4aaa6366 None None] MFA Rules not processed for user `d7dd13d1c9594591bf8d4ca511f39113`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:01.908838 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c7db4b0c-13a3-40ea-ad79-1afa4aaa6366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:01.937897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:01.938592 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:01.938921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:01.939178 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:01.940958 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:01.953854 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:01.955508 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:01.966172 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1378/2774] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:01.979261 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1397/2775] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:01 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:01.990020 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:01.992039 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:02.053942 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f0a6-b33a-4ad3-b489-e30384ead636 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:02.057747 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7086d19-a37f-454c-8eff-5f44eb5b347c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:02.058414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086d19-a37f-454c-8eff-5f44eb5b347c service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:02.058699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086d19-a37f-454c-8eff-5f44eb5b347c service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:02.058989 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7086d19-a37f-454c-8eff-5f44eb5b347c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:02.069194 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7086d19-a37f-454c-8eff-5f44eb5b347c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:02.070750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7086d19-a37f-454c-8eff-5f44eb5b347c service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:02.080276 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1379/2776] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:01 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:02.574235 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db4b0c-13a3-40ea-ad79-1afa4aaa6366 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:02.635490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db4b0c-13a3-40ea-ad79-1afa4aaa6366 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:02.640544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:02.641409 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:02.641692 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:02.643182 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] PATH_INFO: `/v3/users/c448e8353e45413cbbdc878e817094bd` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:02.643447 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c448e8353e45413cbbdc878e817094bd)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:02.645362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:02.830913 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c448e8353e45413cbbdc878e817094bd'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:02.844136 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c448e8353e45413cbbdc878e817094bd'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:02.845460 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c448e8353e45413cbbdc878e817094bd'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:02.846085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c448e8353e45413cbbdc878e817094bd'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:02.853117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c448e8353e45413cbbdc878e817094bd'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:02.974855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1398/2777] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:02 2021] DELETE /identity/v3/users/c448e8353e45413cbbdc878e817094bd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:02.979373 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:02.979848 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:02.979948 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:02.996836 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:02.998124 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:03.059360 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1380/2778] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:03.070285 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:03.071726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:03.126306 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7682cd4-3364-4738-ad59-6552f6a92dd0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:03.130542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:03.131187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:03.131466 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:03.131746 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:03.141081 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:03.143367 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:03.152563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1399/2779] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:03.550698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:03.552335 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:03.567513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf351f-c88b-4343-be3f-d02bd39d9041 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:03.573207 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:03.574702 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:03.575281 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:03.575704 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] PATH_INFO: `/v3/projects/3ea3f20144fc46a59953f43449a6cf40` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:03.577170 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea3f20144fc46a59953f43449a6cf40)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:03.582512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:03.674607 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea3f20144fc46a59953f43449a6cf40', 'request_id': 'req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:03.680127 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea3f20144fc46a59953f43449a6cf40', 'request_id': 'req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:03.788564 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea3f20144fc46a59953f43449a6cf40', 'request_id': 'req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:03.800765 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] The token cache is being invalidate because project 3ea3f20144fc46a59953f43449a6cf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:03.801042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:03.801676 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:03.803256 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1381/2780] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:03 2021] DELETE /identity/v3/projects/3ea3f20144fc46a59953f43449a6cf40 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:03.807300 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:03.816935 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f5f7d-a8dd-4242-bddf-e34c56dbd13e service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:03.872760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:03.873623 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:03.873908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:03.874201 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] PATH_INFO: `/v3/users/d7dd13d1c9594591bf8d4ca511f39113` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:03.875538 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dd13d1c9594591bf8d4ca511f39113)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:03.877661 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:04.092633 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dd13d1c9594591bf8d4ca511f39113'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.104314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dd13d1c9594591bf8d4ca511f39113'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.104988 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dd13d1c9594591bf8d4ca511f39113'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.105591 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dd13d1c9594591bf8d4ca511f39113'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.113394 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e2d4f462-ad60-405a-99ed-4c35d4fe90b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dd13d1c9594591bf8d4ca511f39113'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.188618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1400/2781] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:03 2021] DELETE /identity/v3/users/d7dd13d1c9594591bf8d4ca511f39113 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:04.588239 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:04.590465 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:04.614883 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed120c4a-a0b5-4ef7-8f56-ca1241d86174 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:04.667513 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:04.668356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:04.668644 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:04.669055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] PATH_INFO: `/v3/projects/db413574480d45d19e72b90c9eb7466c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:04.670375 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db413574480d45d19e72b90c9eb7466c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:04.672349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:04.810646 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db413574480d45d19e72b90c9eb7466c', 'request_id': 'req-1dedad66-8f90-4276-92c3-9487eb7642c1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.816860 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db413574480d45d19e72b90c9eb7466c', 'request_id': 'req-1dedad66-8f90-4276-92c3-9487eb7642c1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.894734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db413574480d45d19e72b90c9eb7466c', 'request_id': 'req-1dedad66-8f90-4276-92c3-9487eb7642c1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.906000 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] The token cache is being invalidate because project db413574480d45d19e72b90c9eb7466c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:04.906318 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.906945 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1dedad66-8f90-4276-92c3-9487eb7642c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:04.908703 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1382/2782] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:04 2021] DELETE /identity/v3/projects/db413574480d45d19e72b90c9eb7466c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:04.914416 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79577-2823-4716-8c44-68feb181db1c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:04.914921 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79577-2823-4716-8c44-68feb181db1c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:04.915022 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79577-2823-4716-8c44-68feb181db1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:04.933691 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1fa79577-2823-4716-8c44-68feb181db1c None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:04.935519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1fa79577-2823-4716-8c44-68feb181db1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:04.994889 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1401/2783] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:05.004922 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99249-9d2e-4a96-bed2-947dff0ae2c8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.005214 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99249-9d2e-4a96-bed2-947dff0ae2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.005498 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99249-9d2e-4a96-bed2-947dff0ae2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.023951 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b3e99249-9d2e-4a96-bed2-947dff0ae2c8 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:05.025286 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b3e99249-9d2e-4a96-bed2-947dff0ae2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:05.033294 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1383/2784] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:05.037486 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa79577-2823-4716-8c44-68feb181db1c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.046984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa79577-2823-4716-8c44-68feb181db1c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.052116 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.052796 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.053084 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.053364 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.054114 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:44:05.054456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.056049 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:05.068407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1402/2785] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:44:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:44:05.072791 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99249-9d2e-4a96-bed2-947dff0ae2c8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.082057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e99249-9d2e-4a96-bed2-947dff0ae2c8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.086814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.087459 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.087742 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.088015 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.088773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.090750 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:05.158042 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1384/2786] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:44:05 2021] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:05.162319 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.172211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3e4d-f64a-48ba-bc97-db2678ce6277 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.228548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.228824 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.229106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.229412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.230130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.232086 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:05.342755 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1403/2787] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:44:05 2021] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:05.346880 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.357132 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0b23-7e4d-426c-bb3a-893796922be7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.361857 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.362534 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.362814 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.363087 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.363821 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.365414 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:05.376205 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1385/2788] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:05.385955 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.397130 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e35f58-938e-4fe0-975c-6090b4b25fb0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.401788 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debffee5-4acb-4b26-807a-2cf5d381e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.402469 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debffee5-4acb-4b26-807a-2cf5d381e648 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.402752 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debffee5-4acb-4b26-807a-2cf5d381e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.403039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debffee5-4acb-4b26-807a-2cf5d381e648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.403760 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debffee5-4acb-4b26-807a-2cf5d381e648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.405332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debffee5-4acb-4b26-807a-2cf5d381e648 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:05.417537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1404/2789] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:05.420613 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.430794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbecf0c-f06d-494f-95d3-389284c39973 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.435424 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.436329 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.436611 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.436884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] PATH_INFO: `/v3/projects/3cd8e76317e7470385a283ae95c18a91/users/0736258278a94981830fb2858b3a2eb3/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.451342 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd8e76317e7470385a283ae95c18a91, user_id=0736258278a94981830fb2858b3a2eb3, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.453950 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:05.580957 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1386/2790] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:05 2021] PUT /identity/v3/projects/3cd8e76317e7470385a283ae95c18a91/users/0736258278a94981830fb2858b3a2eb3/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:05.591226 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728f6aa-b6d7-4235-bec2-4b5448f00626 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.591550 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728f6aa-b6d7-4235-bec2-4b5448f00626 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.591832 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728f6aa-b6d7-4235-bec2-4b5448f00626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.617978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e728f6aa-b6d7-4235-bec2-4b5448f00626 None None] MFA Rules not processed for user `0736258278a94981830fb2858b3a2eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:05.619208 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e728f6aa-b6d7-4235-bec2-4b5448f00626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:05.687041 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1405/2791] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:05.698013 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.699698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:05.755506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7e1b7-83b5-4d76-903e-dbc9826f621a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.759252 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6159e-42bf-4095-8561-5ce24e2a99b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.777881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6159e-42bf-4095-8561-5ce24e2a99b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.777881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6159e-42bf-4095-8561-5ce24e2a99b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.777881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6159e-42bf-4095-8561-5ce24e2a99b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.777881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6159e-42bf-4095-8561-5ce24e2a99b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.777881 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6159e-42bf-4095-8561-5ce24e2a99b2 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:05.779267 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1387/2792] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:05 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:05.799908 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728f6aa-b6d7-4235-bec2-4b5448f00626 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:05.859989 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728f6aa-b6d7-4235-bec2-4b5448f00626 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:05.865653 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:05.866544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:05.866829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:05.867106 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] PATH_INFO: `/v3/users/0736258278a94981830fb2858b3a2eb3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:05.868398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0736258278a94981830fb2858b3a2eb3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:05.870332 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:06.047680 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0736258278a94981830fb2858b3a2eb3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.060123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0736258278a94981830fb2858b3a2eb3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.060816 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0736258278a94981830fb2858b3a2eb3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.061457 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0736258278a94981830fb2858b3a2eb3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.068622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0736258278a94981830fb2858b3a2eb3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.136246 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1406/2793] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:05 2021] DELETE /identity/v3/users/0736258278a94981830fb2858b3a2eb3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:06.140777 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:06.141078 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:06.141361 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:06.158907 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:06.160167 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:06.216212 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1388/2794] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:44:06.226546 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:06.227959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:06.282576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895e9ed-fc9e-4687-8dcc-2ae136f148d2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:06.287063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90017e03-b468-4266-a460-26da2b5a9dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:06.287705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017e03-b468-4266-a460-26da2b5a9dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:06.287991 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017e03-b468-4266-a460-26da2b5a9dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:06.288270 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90017e03-b468-4266-a460-26da2b5a9dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:06.297164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90017e03-b468-4266-a460-26da2b5a9dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:06.299348 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90017e03-b468-4266-a460-26da2b5a9dd8 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:06.308385 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1407/2795] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:06.715454 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:06.716864 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:06.731461 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620a5e-96fc-4da2-b184-e2a0d5b1d8af None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:06.736189 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:06.738058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:06.738451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:06.738656 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] PATH_INFO: `/v3/projects/3cd8e76317e7470385a283ae95c18a91` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:06.739876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd8e76317e7470385a283ae95c18a91)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:06.741844 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:06.850849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd8e76317e7470385a283ae95c18a91', 'request_id': 'req-95937a70-5162-4020-a448-6ddbac55227f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.856143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd8e76317e7470385a283ae95c18a91', 'request_id': 'req-95937a70-5162-4020-a448-6ddbac55227f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.936633 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd8e76317e7470385a283ae95c18a91', 'request_id': 'req-95937a70-5162-4020-a448-6ddbac55227f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.948471 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] The token cache is being invalidate because project 3cd8e76317e7470385a283ae95c18a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:06.948757 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.949378 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-95937a70-5162-4020-a448-6ddbac55227f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:06.950947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1389/2796] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:06 2021] DELETE /identity/v3/projects/3cd8e76317e7470385a283ae95c18a91 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:06.957611 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d6237-0c7c-487d-a844-94174ddc78fc None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:06.957990 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d6237-0c7c-487d-a844-94174ddc78fc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:06.958313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d6237-0c7c-487d-a844-94174ddc78fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:06.976357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-841d6237-0c7c-487d-a844-94174ddc78fc None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:06.977602 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-841d6237-0c7c-487d-a844-94174ddc78fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:07.036013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1408/2797] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:44:07.043896 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9c597-bcd4-4fb2-98d1-26bffee72463 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.044237 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9c597-bcd4-4fb2-98d1-26bffee72463 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.044524 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9c597-bcd4-4fb2-98d1-26bffee72463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.062869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-30c9c597-bcd4-4fb2-98d1-26bffee72463 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:07.064068 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-30c9c597-bcd4-4fb2-98d1-26bffee72463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:07.072884 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1390/2798] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:07.077057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d6237-0c7c-487d-a844-94174ddc78fc None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.087559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d6237-0c7c-487d-a844-94174ddc78fc None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.092099 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.092749 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.093038 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.093318 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.094066 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:44:07.094585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.096228 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:07.107484 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1409/2799] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:44:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:44:07.111743 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9c597-bcd4-4fb2-98d1-26bffee72463 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.120794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9c597-bcd4-4fb2-98d1-26bffee72463 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.125647 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.126394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.127321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.127321 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.128201 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.130097 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:07.239340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1391/2800] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:44:07 2021] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:07.243189 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.253607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da67635-5f08-47cf-bd15-8c72b32776d6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.307668 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.308326 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.308608 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.308883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.309637 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.311566 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:07.386020 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1410/2801] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:44:07 2021] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:07.389910 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.401047 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3ee4-1d37-4420-bf3c-ea7fdc03bc00 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.405669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.406344 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.406675 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.406947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.407717 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.410053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:07.420088 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1392/2802] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:07.423839 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.433830 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e80e30-af62-453c-ba75-c0491b585d54 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.438607 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0eed3-352a-4265-a413-70afbf89ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.439265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0eed3-352a-4265-a413-70afbf89ad87 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.439548 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0eed3-352a-4265-a413-70afbf89ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.439828 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0eed3-352a-4265-a413-70afbf89ad87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.440577 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0eed3-352a-4265-a413-70afbf89ad87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.442159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0eed3-352a-4265-a413-70afbf89ad87 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:07.451926 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1411/2803] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:07.456489 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.465959 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfea01-194e-482b-b4b9-48d2ae5afd9c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.471243 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.472089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.472367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.472638 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] PATH_INFO: `/v3/projects/fb7cd9e9ab714029bb26539cfcfe2817/users/4c73a3dd4371415b9f0381033885543c/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.486371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7cd9e9ab714029bb26539cfcfe2817, user_id=4c73a3dd4371415b9f0381033885543c, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.488985 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:07.605897 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1393/2804] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:07 2021] PUT /identity/v3/projects/fb7cd9e9ab714029bb26539cfcfe2817/users/4c73a3dd4371415b9f0381033885543c/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:07.617074 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa066214-021f-4aa8-96cc-ad9ea6de4c3c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.617373 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa066214-021f-4aa8-96cc-ad9ea6de4c3c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.617656 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa066214-021f-4aa8-96cc-ad9ea6de4c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.645122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fa066214-021f-4aa8-96cc-ad9ea6de4c3c None None] MFA Rules not processed for user `4c73a3dd4371415b9f0381033885543c`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:07.646302 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fa066214-021f-4aa8-96cc-ad9ea6de4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:07.708168 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1412/2805] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:07 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:07.712371 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.770698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fcc2d4-a8cb-4abb-b940-81148404b3e4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.775499 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.776166 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.776479 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.776762 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.777507 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.779458 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:07.870331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1394/2806] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:44:07 2021] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:07.874354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa066214-021f-4aa8-96cc-ad9ea6de4c3c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:07.885025 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa066214-021f-4aa8-96cc-ad9ea6de4c3c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:07.941523 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:07.942343 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:07.946844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:07.946844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:07.946844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:07.946844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.057544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1413/2807] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:44:07 2021] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:08.061658 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.072235 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66ac32-d798-40e2-9c0b-10a952bbb4a0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.077090 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.077773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.078057 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.078394 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.079148 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.081706 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.092890 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1395/2808] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:08.102657 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.112575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffd07-4945-4e89-bd86-4ae3fab17b54 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.117192 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccecc29-cf01-4ab4-99a8-1a5e0d847080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.117842 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecc29-cf01-4ab4-99a8-1a5e0d847080 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.118127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecc29-cf01-4ab4-99a8-1a5e0d847080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.118432 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecc29-cf01-4ab4-99a8-1a5e0d847080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.119162 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccecc29-cf01-4ab4-99a8-1a5e0d847080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.120726 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccecc29-cf01-4ab4-99a8-1a5e0d847080 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.130851 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1414/2809] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:08.136663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.147684 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce0c86-2a88-4aa6-868c-0894d55a3d3e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.152494 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.155720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.155720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.155720 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] PATH_INFO: `/v3/projects/7bbbe992999842cca30ee9e8dd70849d/users/7200ab70e99c46bebc8d5060269dfa18/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.169327 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbbe992999842cca30ee9e8dd70849d, user_id=7200ab70e99c46bebc8d5060269dfa18, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.172001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.245069 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1396/2810] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:08 2021] PUT /identity/v3/projects/7bbbe992999842cca30ee9e8dd70849d/users/7200ab70e99c46bebc8d5060269dfa18/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:08.256052 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705a2d-5580-4924-a5ae-4baaa90d7ed4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.256369 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705a2d-5580-4924-a5ae-4baaa90d7ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.256650 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b705a2d-5580-4924-a5ae-4baaa90d7ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.284187 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1b705a2d-5580-4924-a5ae-4baaa90d7ed4 None None] MFA Rules not processed for user `7200ab70e99c46bebc8d5060269dfa18`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:08.285390 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1b705a2d-5580-4924-a5ae-4baaa90d7ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:08.349600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1415/2811] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:08 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:08.354155 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.414436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94744cb-be38-4ec3-86d9-3ccde38d396c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.419055 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.419701 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.419983 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.420257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.420964 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.422913 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.526595 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1397/2812] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:44:08 2021] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:08.530593 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b705a2d-5580-4924-a5ae-4baaa90d7ed4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.541330 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b705a2d-5580-4924-a5ae-4baaa90d7ed4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.596547 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.597381 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.597671 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.597951 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.598707 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.600670 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.673397 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1416/2813] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:44:08 2021] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:08.677828 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.687894 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314f91-7e98-4662-bd5e-3376076a71f6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.693014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.693657 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.693939 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.694241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.694969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.696616 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.706889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1398/2814] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:08.711027 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.721458 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060625c-1c58-47d6-b30d-1e3e7c78924e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.726223 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.727143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.727362 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.727641 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] PATH_INFO: `/v3/projects/5b19010871204deca20bb422fbb1ea43/users/dfc5f736281747f7aadd909108854c68/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.743177 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b19010871204deca20bb422fbb1ea43, user_id=dfc5f736281747f7aadd909108854c68, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.745791 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.815039 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1417/2815] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:08 2021] PUT /identity/v3/projects/5b19010871204deca20bb422fbb1ea43/users/dfc5f736281747f7aadd909108854c68/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:44:08.818981 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.828668 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120df2-514b-4ff7-a521-4270126e11db admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.883445 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187e071-eada-4e00-b092-5c4fb42dbed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.884104 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e071-eada-4e00-b092-5c4fb42dbed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.884387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e071-eada-4e00-b092-5c4fb42dbed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.884663 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e071-eada-4e00-b092-5c4fb42dbed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.885395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187e071-eada-4e00-b092-5c4fb42dbed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.887014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187e071-eada-4e00-b092-5c4fb42dbed2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.897112 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1399/2816] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:08 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:08.901265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:08.911659 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b242718-faef-406f-9e89-723af154f1c2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:08.917258 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:08.918129 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.918455 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.918725 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] PATH_INFO: `/v3/projects/5b19010871204deca20bb422fbb1ea43/users/dfc5f736281747f7aadd909108854c68/roles/08583b4d4b434a4594ee6864e55939c5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.920690 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b19010871204deca20bb422fbb1ea43, user_id=dfc5f736281747f7aadd909108854c68, role_id=08583b4d4b434a4594ee6864e55939c5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:08.923337 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:08.934709 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1418/2817] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:08 2021] PUT /identity/v3/projects/5b19010871204deca20bb422fbb1ea43/users/dfc5f736281747f7aadd909108854c68/roles/08583b4d4b434a4594ee6864e55939c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:08.946798 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ddee-c342-41e8-b7d9-bbfc2fbf601e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:08.947109 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ddee-c342-41e8-b7d9-bbfc2fbf601e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:08.947384 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ddee-c342-41e8-b7d9-bbfc2fbf601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:08.972769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7726ddee-c342-41e8-b7d9-bbfc2fbf601e None None] MFA Rules not processed for user `dfc5f736281747f7aadd909108854c68`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:08.976125 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7726ddee-c342-41e8-b7d9-bbfc2fbf601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:09.039914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1400/2818] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:08 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:09.050984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:09.052674 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:09.107880 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14340d0a-2e7d-4428-a869-2a9533af2c6b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:09.112103 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:09.112731 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:09.113016 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:09.113295 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:09.166420 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:09.167850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:09.177257 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1419/2819] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:11.273257 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ddee-c342-41e8-b7d9-bbfc2fbf601e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:11.282973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ddee-c342-41e8-b7d9-bbfc2fbf601e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:11.286605 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:11.287244 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:11.287528 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:11.287804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:11.344451 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:11.345929 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:11.355224 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1401/2820] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:11 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:12.965581 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:12.974615 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676947-5bfd-47dc-b481-0b7cf9009e58 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:12.978379 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d81cf-8ae0-4965-9376-c7a78af0c974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:12.978958 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d81cf-8ae0-4965-9376-c7a78af0c974 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:12.979242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d81cf-8ae0-4965-9376-c7a78af0c974 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:12.979519 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d81cf-8ae0-4965-9376-c7a78af0c974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:12.989127 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d81cf-8ae0-4965-9376-c7a78af0c974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:12.990630 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d81cf-8ae0-4965-9376-c7a78af0c974 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:13.000705 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1420/2821] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:12 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:21.214998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:21.276477 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18076984-b8d0-47e3-9a4c-a9b9ba2ce9fb service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:21.281230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:21.282089 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:21.282405 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:21.282687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] PATH_INFO: `/v3/users/4c73a3dd4371415b9f0381033885543c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:21.283904 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c73a3dd4371415b9f0381033885543c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:21.285865 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:21.452700 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c73a3dd4371415b9f0381033885543c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:21.455754 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c73a3dd4371415b9f0381033885543c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:21.465049 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c73a3dd4371415b9f0381033885543c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:21.465670 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c73a3dd4371415b9f0381033885543c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:21.522011 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c73a3dd4371415b9f0381033885543c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:21.533973 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1402/2822] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:21 2021] DELETE /identity/v3/users/4c73a3dd4371415b9f0381033885543c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:21.540166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:21.540166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:21.540166 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:21.557314 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:21.558562 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:21.614647 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1421/2823] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:21.626263 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:21.627738 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:21.684376 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ea23-12d5-4721-bac1-a6976166b48f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:21.688176 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:21.688804 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:21.689085 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:21.689356 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:21.699139 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:21.700855 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:21.714877 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1403/2824] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:22.127282 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:22.128964 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:22.141303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b6527-2f64-4d4a-baf3-340d94ec62e3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:22.146470 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:22.147335 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:22.147622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:22.147902 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] PATH_INFO: `/v3/projects/fb7cd9e9ab714029bb26539cfcfe2817` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:22.149237 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7cd9e9ab714029bb26539cfcfe2817)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:22.151730 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:22.283274 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7cd9e9ab714029bb26539cfcfe2817', 'request_id': 'req-f47284f5-6fd5-43cd-b20f-fdb56f80620b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.290527 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7cd9e9ab714029bb26539cfcfe2817', 'request_id': 'req-f47284f5-6fd5-43cd-b20f-fdb56f80620b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.370904 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7cd9e9ab714029bb26539cfcfe2817', 'request_id': 'req-f47284f5-6fd5-43cd-b20f-fdb56f80620b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.382347 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] The token cache is being invalidate because project fb7cd9e9ab714029bb26539cfcfe2817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:22.382642 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.383278 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.384833 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1422/2825] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:22 2021] DELETE /identity/v3/projects/fb7cd9e9ab714029bb26539cfcfe2817 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:22.388962 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:22.398914 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43567ab2-c325-4ad8-991c-00e86b25d316 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:22.453556 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:22.454448 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:22.454769 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:22.455014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] PATH_INFO: `/v3/users/7200ab70e99c46bebc8d5060269dfa18` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:22.456215 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7200ab70e99c46bebc8d5060269dfa18)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:22.458133 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:22.615947 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7200ab70e99c46bebc8d5060269dfa18'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.616608 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7200ab70e99c46bebc8d5060269dfa18'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.627994 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7200ab70e99c46bebc8d5060269dfa18'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.630695 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7200ab70e99c46bebc8d5060269dfa18'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.707547 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7200ab70e99c46bebc8d5060269dfa18'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:22.719889 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1404/2826] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:22 2021] DELETE /identity/v3/users/7200ab70e99c46bebc8d5060269dfa18 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:23.183542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:23.185019 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:23.206456 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47284f5-6fd5-43cd-b20f-fdb56f80620b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:23.262718 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:23.263569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:23.263850 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:23.264123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] PATH_INFO: `/v3/projects/7bbbe992999842cca30ee9e8dd70849d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:23.265312 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbbe992999842cca30ee9e8dd70849d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:23.267520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:23.382700 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbbe992999842cca30ee9e8dd70849d', 'request_id': 'req-917529e1-643a-44ef-a95a-114ed858f008'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.388845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbbe992999842cca30ee9e8dd70849d', 'request_id': 'req-917529e1-643a-44ef-a95a-114ed858f008'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.432984 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbbe992999842cca30ee9e8dd70849d', 'request_id': 'req-917529e1-643a-44ef-a95a-114ed858f008'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.443979 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] The token cache is being invalidate because project 7bbbe992999842cca30ee9e8dd70849d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:23.450085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.450085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.450085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1423/2827] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:23 2021] DELETE /identity/v3/projects/7bbbe992999842cca30ee9e8dd70849d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:44:23.451241 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:23.452729 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:23.466740 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8424cb-efb5-429f-bbde-f163b8d70435 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:23.523082 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:23.523948 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:23.524234 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:23.524512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] PATH_INFO: `/v3/users/dfc5f736281747f7aadd909108854c68` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:23.525734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc5f736281747f7aadd909108854c68)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:23.527687 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:23.704581 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc5f736281747f7aadd909108854c68'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.705259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc5f736281747f7aadd909108854c68'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.717022 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc5f736281747f7aadd909108854c68'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.718570 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc5f736281747f7aadd909108854c68'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.790589 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a093d1bc-343a-4f66-8df3-5b9ff3414fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc5f736281747f7aadd909108854c68'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:23.803509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1405/2828] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:23 2021] DELETE /identity/v3/users/dfc5f736281747f7aadd909108854c68 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:24.183570 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:24.186122 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:24.198627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917529e1-643a-44ef-a95a-114ed858f008 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:24.257118 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:24.257968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.258292 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.258575 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] PATH_INFO: `/v3/projects/5b19010871204deca20bb422fbb1ea43` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.259767 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b19010871204deca20bb422fbb1ea43)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:24.261686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:24.376998 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b19010871204deca20bb422fbb1ea43', 'request_id': 'req-a552a772-7926-47ff-a11c-c9cc653f6735'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:24.384060 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b19010871204deca20bb422fbb1ea43', 'request_id': 'req-a552a772-7926-47ff-a11c-c9cc653f6735'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:24.450687 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b19010871204deca20bb422fbb1ea43', 'request_id': 'req-a552a772-7926-47ff-a11c-c9cc653f6735'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:24.462057 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] The token cache is being invalidate because project 5b19010871204deca20bb422fbb1ea43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:24.462387 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:24.463005 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a552a772-7926-47ff-a11c-c9cc653f6735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:24.464542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1424/2829] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:24 2021] DELETE /identity/v3/projects/5b19010871204deca20bb422fbb1ea43 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:24.470236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db055d6-363a-4de5-a7da-40c649b29c75 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.470712 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db055d6-363a-4de5-a7da-40c649b29c75 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.470816 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db055d6-363a-4de5-a7da-40c649b29c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.490711 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5db055d6-363a-4de5-a7da-40c649b29c75 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:24.491944 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5db055d6-363a-4de5-a7da-40c649b29c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:24.551868 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1406/2830] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:24.559963 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf755d-7406-4b96-8a96-c132416c9e51 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.560299 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf755d-7406-4b96-8a96-c132416c9e51 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.560585 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf755d-7406-4b96-8a96-c132416c9e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.578893 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7acf755d-7406-4b96-8a96-c132416c9e51 None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:24.580092 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7acf755d-7406-4b96-8a96-c132416c9e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:24.588475 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1425/2831] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:24.592796 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db055d6-363a-4de5-a7da-40c649b29c75 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:24.603156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db055d6-363a-4de5-a7da-40c649b29c75 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:24.607876 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:24.608544 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.608815 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.609091 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.609826 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:44:24.610135 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:24.611789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:24.623560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1407/2832] 10.222.0.11 () {58 vars in 1152 bytes} [Thu Nov 11 16:44:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:44:24.627968 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf755d-7406-4b96-8a96-c132416c9e51 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:24.637443 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf755d-7406-4b96-8a96-c132416c9e51 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:24.642563 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:24.643211 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.643490 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.643783 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.644482 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:24.646909 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:24.735119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1426/2833] 10.222.0.11 () {60 vars in 1152 bytes} [Thu Nov 11 16:44:24 2021] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:24.739230 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:24.749006 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab885b-68a0-46d3-a304-2508eee15894 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:24.804573 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:24.805236 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.805522 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.805811 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.806554 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:24.808506 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:24.905250 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1408/2834] 10.222.0.11 () {60 vars in 1143 bytes} [Thu Nov 11 16:44:24 2021] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:44:24.909304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:24.919569 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a702-2176-4bae-839f-bc1e00841006 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:24.924174 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:24.924829 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.925117 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.925398 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.926395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:24.928542 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:24.938938 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1427/2835] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:24.943357 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:24.953280 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e7eac-8a41-4a3a-b506-9803855899da admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:24.958763 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d2036-f109-4713-a4ee-84e0ed1da7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:24.959411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d2036-f109-4713-a4ee-84e0ed1da7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.959698 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d2036-f109-4713-a4ee-84e0ed1da7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.959978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d2036-f109-4713-a4ee-84e0ed1da7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:24.960722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d2036-f109-4713-a4ee-84e0ed1da7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:24.962392 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d2036-f109-4713-a4ee-84e0ed1da7f1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:24.972075 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1409/2836] 10.222.0.11 () {58 vars in 1121 bytes} [Thu Nov 11 16:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:44:24.976120 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:24.989137 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b4133-28c4-4046-84ce-3a9fd86e1216 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:24.990493 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:24.991357 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:24.991639 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:24.991918 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] PATH_INFO: `/v3/projects/cd7c8febad85489fba462a0a22b80390/users/cd47e3fb50234a92b47fe4555ae673a4/roles/f2eb341fe747486eb32039f7dcda8bc2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:25.006304 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7c8febad85489fba462a0a22b80390, user_id=cd47e3fb50234a92b47fe4555ae673a4, role_id=f2eb341fe747486eb32039f7dcda8bc2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:25.008992 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:25.128303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1428/2837] 10.222.0.11 () {60 vars in 1482 bytes} [Thu Nov 11 16:44:24 2021] PUT /identity/v3/projects/cd7c8febad85489fba462a0a22b80390/users/cd47e3fb50234a92b47fe4555ae673a4/roles/f2eb341fe747486eb32039f7dcda8bc2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:25.139192 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9929a-79bf-4365-9eef-96fea99ba8e7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:25.139514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9929a-79bf-4365-9eef-96fea99ba8e7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:25.139794 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9929a-79bf-4365-9eef-96fea99ba8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:25.165869 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-91f9929a-79bf-4365-9eef-96fea99ba8e7 None None] MFA Rules not processed for user `cd47e3fb50234a92b47fe4555ae673a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:25.167105 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-91f9929a-79bf-4365-9eef-96fea99ba8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:25.229789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1410/2838] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:25 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:25.240265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:25.241895 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:25.296520 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1478b-b32b-4fb1-a484-0478b9ce6616 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:25.300184 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90779e40db745b3ba36fe213880bb4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:25.301524 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:25.301848 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:25.302193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:25.310395 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:25.311866 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:25.321243 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1429/2839] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:25 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:27.057197 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:27.057699 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:27.057849 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:27.077758 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] MFA Rules not processed for user `cd47e3fb50234a92b47fe4555ae673a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:27.078923 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:27.086749 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1411/2840] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:27 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:27.649196 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:27.650721 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:27.725446 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c8214-b71e-4625-992f-5bf2faef47d1 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:27.730686 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a0c26778994b0c93541400cde47bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:27.731336 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:27.731624 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:27.731903 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:27.733689 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:27.745600 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:27.747308 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:27.757835 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1430/2841] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:30.324927 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:30.326416 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:30.392708 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07bc1e-c0c0-447a-8fd3-89b21ba9ad0e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:30.398614 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:30.399532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:30.399767 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:30.400046 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] PATH_INFO: `/v3/users/e0d5aa0d35a943a0a970c111ee02a426` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:30.401296 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d5aa0d35a943a0a970c111ee02a426)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:30.403386 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:30.584998 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d5aa0d35a943a0a970c111ee02a426'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:30.585776 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d5aa0d35a943a0a970c111ee02a426'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:30.601496 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d5aa0d35a943a0a970c111ee02a426'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:30.602288 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d5aa0d35a943a0a970c111ee02a426'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:30.671043 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d5aa0d35a943a0a970c111ee02a426'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:30.684233 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1412/2842] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:30 2021] DELETE /identity/v3/users/e0d5aa0d35a943a0a970c111ee02a426 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:30.981899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:30.994959 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094362e-ffc8-473f-8981-9e48d219c9e1 service placement] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:31.078971 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:31.079841 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:31.080132 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:31.080414 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] PATH_INFO: `/v3/projects/a11d5f8528104d4aa6cd6a4097b19cb2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:31.081697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11d5f8528104d4aa6cd6a4097b19cb2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:31.084316 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:31.221155 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11d5f8528104d4aa6cd6a4097b19cb2', 'request_id': 'req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:31.228164 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11d5f8528104d4aa6cd6a4097b19cb2', 'request_id': 'req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:31.255565 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:31.256995 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:31.296085 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11d5f8528104d4aa6cd6a4097b19cb2', 'request_id': 'req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:31.306883 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] The token cache is being invalidate because project a11d5f8528104d4aa6cd6a4097b19cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:31.307119 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:31.307747 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:31.309303 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1431/2843] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:30 2021] DELETE /identity/v3/projects/a11d5f8528104d4aa6cd6a4097b19cb2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:31.322450 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc726779-9ba8-46a5-94e6-b71e54da0674 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:31.370314 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb4dee-e99f-4f1e-9738-5f8c5d5ba903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:31.371137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4dee-e99f-4f1e-9738-5f8c5d5ba903 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:31.371563 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4dee-e99f-4f1e-9738-5f8c5d5ba903 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:31.371921 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4dee-e99f-4f1e-9738-5f8c5d5ba903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:31.375387 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5bfb4dee-e99f-4f1e-9738-5f8c5d5ba903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:31.386156 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb4dee-e99f-4f1e-9738-5f8c5d5ba903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:31.387664 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb4dee-e99f-4f1e-9738-5f8c5d5ba903 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:31.397915 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1413/2844] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:31 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:44:37.329195 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:37.330758 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:37.405660 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401aeb2-4ca9-4a7d-83ca-1d4e8a8a47fb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:37.411441 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:37.415045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:37.415045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:37.415045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:37.415045 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:37.427682 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:37.429540 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:37.440576 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1432/2845] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:43.328274 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0dfc-129d-4aa8-9e94-9c75b3db4923 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:43.328773 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0dfc-129d-4aa8-9e94-9c75b3db4923 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:43.328978 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0dfc-129d-4aa8-9e94-9c75b3db4923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:43.347961 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-af0e0dfc-129d-4aa8-9e94-9c75b3db4923 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:43.349322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-af0e0dfc-129d-4aa8-9e94-9c75b3db4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:43.409161 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1414/2846] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:44:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:43.529181 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:43.530627 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:43.602530 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dc52e-a3b2-428d-8b15-1b68086246a3 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:43.607728 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:43.608376 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:43.608665 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:43.608945 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:43.617100 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:43.618970 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:43.626899 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1433/2847] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:44:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:44:44.441058 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52eec7-237b-4094-8feb-069e4de07670 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:44.441509 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52eec7-237b-4094-8feb-069e4de07670 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:44.441627 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52eec7-237b-4094-8feb-069e4de07670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:44.460194 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3d52eec7-237b-4094-8feb-069e4de07670 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:44.461380 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3d52eec7-237b-4094-8feb-069e4de07670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:44.468620 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1415/2848] 10.222.0.11 () {58 vars in 967 bytes} [Thu Nov 11 16:44:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:44.481200 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:44.491502 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff8644-a12f-4cc1-af62-d22cab7f0bf8 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:44.497013 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:44.497644 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:44.497928 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:44.498236 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:44.506037 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:44.507645 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:44.516076 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1434/2849] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:44:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:44:45.159411 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385131b-a674-4c20-8505-63598fe0c5e7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:45.159819 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385131b-a674-4c20-8505-63598fe0c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:45.160101 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385131b-a674-4c20-8505-63598fe0c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:45.178484 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e385131b-a674-4c20-8505-63598fe0c5e7 None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:45.179734 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e385131b-a674-4c20-8505-63598fe0c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:45.187001 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1416/2850] 10.222.0.11 () {58 vars in 1009 bytes} [Thu Nov 11 16:44:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:45.199622 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:45.209967 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374bfd1-6308-4808-9105-7510019061d6 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:45.215683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:45.221250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:45.221250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:45.221250 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:45.224702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:45.226296 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:45.234793 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1435/2851] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:44:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:44:45.853295 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:45.854014 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:45.854340 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:45.872143 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] MFA Rules not processed for user `9f7408badb7143c097d6450cb1e2ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:45.873331 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:45.880669 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1417/2852] 10.222.0.11 () {58 vars in 967 bytes} [Thu Nov 11 16:44:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:45.894148 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:45.905191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc6ec0-897f-47c4-b0d8-845d014c7b41 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:45.910298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bed0c-8149-48b0-aa5f-1b47b4ec4ae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43db7d84ce72442cbccd9ee65c70551b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:45.910932 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bed0c-8149-48b0-aa5f-1b47b4ec4ae7 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:45.911248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bed0c-8149-48b0-aa5f-1b47b4ec4ae7 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:45.911531 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bed0c-8149-48b0-aa5f-1b47b4ec4ae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:45.919583 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bed0c-8149-48b0-aa5f-1b47b4ec4ae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:45.921159 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bed0c-8149-48b0-aa5f-1b47b4ec4ae7 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:45.929029 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1436/2853] 10.222.0.11 () {60 vars in 1384 bytes} [Thu Nov 11 16:44:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:44:48.620322 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:48.621722 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:48.683934 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb221c7c-2514-406e-bbbd-d721bcb8b3ab None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:48.688406 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:48.689255 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:48.689532 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:48.689800 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] PATH_INFO: `/v3/users/cd47e3fb50234a92b47fe4555ae673a4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:48.691016 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd47e3fb50234a92b47fe4555ae673a4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:48.692937 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:48.860301 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd47e3fb50234a92b47fe4555ae673a4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:48.860838 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd47e3fb50234a92b47fe4555ae673a4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:48.872654 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd47e3fb50234a92b47fe4555ae673a4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:48.873436 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd47e3fb50234a92b47fe4555ae673a4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:48.980891 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd47e3fb50234a92b47fe4555ae673a4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:48.993119 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1418/2854] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:44:48 2021] DELETE /identity/v3/users/cd47e3fb50234a92b47fe4555ae673a4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:44:48.998716 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:48.999191 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:48.999298 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:49.017821 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] MFA Rules not processed for user `6fe756dac77c46179eda340982f2b52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:44:49.019053 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:49.077224 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1437/2855] 10.222.0.11 () {58 vars in 957 bytes} [Thu Nov 11 16:44:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:44:49.086920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:49.088349 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:49.144277 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc334e19-051c-4561-8f39-671bb00f321d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:49.147859 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:49.148497 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:49.148781 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:49.149072 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:49.158226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:49.159672 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:49.169484 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1419/2856] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:44:49.394544 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:49.395901 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:49.407981 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d333680-97d7-4c2d-bcf1-63ee7a151a5e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:49.412697 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:49.413559 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:49.413844 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:49.414123 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] PATH_INFO: `/v3/projects/cd7c8febad85489fba462a0a22b80390` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:49.415354 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7c8febad85489fba462a0a22b80390)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:49.417969 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:49.523220 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7c8febad85489fba462a0a22b80390', 'request_id': 'req-dbce4177-5013-4533-8ee5-adf241d2e985'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:49.529277 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7c8febad85489fba462a0a22b80390', 'request_id': 'req-dbce4177-5013-4533-8ee5-adf241d2e985'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:49.609702 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7c8febad85489fba462a0a22b80390', 'request_id': 'req-dbce4177-5013-4533-8ee5-adf241d2e985'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:49.620479 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] The token cache is being invalidate because project cd7c8febad85489fba462a0a22b80390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:44:49.620765 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:49.621377 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:44:49.623073 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1438/2857] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:44:49 2021] DELETE /identity/v3/projects/cd7c8febad85489fba462a0a22b80390 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:44:51.852009 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:44:51.854790 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:51.946623 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e256fb0-2ece-46f8-89d2-be2cd930eaeb service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:44:52.011303 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cb1d1929f8b40efa72d290b23c8f1e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:44:52.011990 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:44:52.012283 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:44:52.012560 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:44:52.014395 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:44:52.027137 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:44:52.028741 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:44:52.039514 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1420/2858] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:44:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:45:05.427063 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:45:05.428537 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:45:05.494685 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce4177-5013-4533-8ee5-adf241d2e985 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:45:05.499481 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25123d6cb4fc417899321ecdb3c76b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:45:05.500150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:45:05.500434 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:45:05.500712 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:45:05.502511 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:45:05.588256 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:45:05.589957 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:45:05.602845 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1439/2859] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:45:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:45:13.181220 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:45:13.182802 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:45:13.248113 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc670c6-8e09-460d-ab48-043a849aec59 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:45:13.252893 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:45:13.256162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:45:13.256162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:45:13.256162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] PATH_INFO: `/v3/users/9cec710bddca4e6c890c99580d172053` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:45:13.256162 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cec710bddca4e6c890c99580d172053)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:45:13.257476 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:45:13.479098 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cec710bddca4e6c890c99580d172053'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:13.479748 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cec710bddca4e6c890c99580d172053'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:13.490963 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cec710bddca4e6c890c99580d172053'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:13.491584 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cec710bddca4e6c890c99580d172053'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:13.575415 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cec710bddca4e6c890c99580d172053'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:13.587920 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1421/2860] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:45:13 2021] DELETE /identity/v3/users/9cec710bddca4e6c890c99580d172053 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:45:13.843046 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:45:13.886497 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca257fd-9380-4aac-a766-4494b610c169 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:45:13.941328 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:45:13.942193 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:45:13.942488 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:45:13.942761 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] PATH_INFO: `/v3/projects/e8b27862260c4e10a2a4649abac781fd` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:45:13.943976 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b27862260c4e10a2a4649abac781fd)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:45:13.945855 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:45:14.048310 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b27862260c4e10a2a4649abac781fd', 'request_id': 'req-280a6d7d-76be-4202-a5e2-27e16ca32f9f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.054463 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b27862260c4e10a2a4649abac781fd', 'request_id': 'req-280a6d7d-76be-4202-a5e2-27e16ca32f9f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.163350 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b27862260c4e10a2a4649abac781fd', 'request_id': 'req-280a6d7d-76be-4202-a5e2-27e16ca32f9f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.174661 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] The token cache is being invalidate because project e8b27862260c4e10a2a4649abac781fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:45:14.174978 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.175618 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.177143 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1440/2861] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:45:13 2021] DELETE /identity/v3/projects/e8b27862260c4e10a2a4649abac781fd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:45:14.181365 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:45:14.183070 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:45:14.196338 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c82ce-363d-4a60-81fc-9de254e9441d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:45:14.251367 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:45:14.252226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:45:14.252510 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:45:14.252787 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] PATH_INFO: `/v3/users/798c1d683bc84498a098c45fc9ad2667` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:45:14.253980 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798c1d683bc84498a098c45fc9ad2667)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:45:14.255938 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:45:14.453726 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798c1d683bc84498a098c45fc9ad2667'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.454442 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798c1d683bc84498a098c45fc9ad2667'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.466602 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798c1d683bc84498a098c45fc9ad2667'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.467249 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798c1d683bc84498a098c45fc9ad2667'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.546259 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798c1d683bc84498a098c45fc9ad2667'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:14.558924 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1422/2862] 10.222.0.11 () {58 vars in 1223 bytes} [Thu Nov 11 16:45:14 2021] DELETE /identity/v3/users/798c1d683bc84498a098c45fc9ad2667 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:45:14.822265 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:45:14.823742 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:45:14.837407 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a6d7d-76be-4202-a5e2-27e16ca32f9f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:45:14.893711 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fe756dac77c46179eda340982f2b52b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e90b3c560e34b33b6dbbbe37d81f1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:45:14.894596 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:45:14.894875 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:45:14.895150 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] PATH_INFO: `/v3/projects/a70d9ab6136f475f8bc6ea3fba6fb28e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:45:14.896325 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70d9ab6136f475f8bc6ea3fba6fb28e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:45:14.898242 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:45:15.026111 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70d9ab6136f475f8bc6ea3fba6fb28e', 'request_id': 'req-da267e49-9480-42d9-ba4d-9fff066312e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:15.032412 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70d9ab6136f475f8bc6ea3fba6fb28e', 'request_id': 'req-da267e49-9480-42d9-ba4d-9fff066312e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:15.153313 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70d9ab6136f475f8bc6ea3fba6fb28e', 'request_id': 'req-da267e49-9480-42d9-ba4d-9fff066312e7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:15.163781 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] The token cache is being invalidate because project a70d9ab6136f475f8bc6ea3fba6fb28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 16:45:15.164065 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:15.164683 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-da267e49-9480-42d9-ba4d-9fff066312e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 16:45:15.166248 dv-cinder-776422-4-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1441/2863] 10.222.0.11 () {58 vars in 1232 bytes} [Thu Nov 11 16:45:14 2021] DELETE /identity/v3/projects/a70d9ab6136f475f8bc6ea3fba6fb28e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:46:48.646512 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:46:48.652789 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:46:48.751226 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1fa92-97f7-4740-bbae-f6cbd9391c46 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:46:48.810053 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2a5a2-a761-4c0d-937b-f3636e0f1c9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a0c26778994b0c93541400cde47bc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9addf7e974ac4c55a90334b0899c8a78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:46:48.810652 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2a5a2-a761-4c0d-937b-f3636e0f1c9a service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:46:48.810940 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2a5a2-a761-4c0d-937b-f3636e0f1c9a service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:46:48.811216 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2a5a2-a761-4c0d-937b-f3636e0f1c9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:46:48.812969 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6fa2a5a2-a761-4c0d-937b-f3636e0f1c9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:46:48.824706 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2a5a2-a761-4c0d-937b-f3636e0f1c9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:46:48.826319 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2a5a2-a761-4c0d-937b-f3636e0f1c9a service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:46:48.836786 dv-cinder-776422-4-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1423/2864] 10.222.0.11 () {60 vars in 1365 bytes} [Thu Nov 11 16:46:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)